Jun 11 05:03:30 devstack cinder-volume[81422]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81422) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 11 05:03:30 devstack cinder-volume[81422]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81422) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 11 05:03:30 devstack cinder-volume[81422]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81422) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 11 05:03:31 devstack cinder-volume[81422]: INFO dbcounter [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Registered counter for database cinder Jun 11 05:03:31 devstack cinder-volume[81422]: DEBUG oslo_db.sqlalchemy.engines [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81422) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 11 05:03:31 devstack cinder-volume[81422]: DEBUG dbcounter [-] [81422] Writer thread running {{(pid=81422) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 11 05:03:31 devstack cinder-volume[81422]: INFO cinder.rpc [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 11 05:03:31 devstack cinder-volume[81422]: INFO cinder.rpc [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 11 05:03:31 devstack cinder-volume[81422]: DEBUG oslo_db.sqlalchemy.engines [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81422) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 11 05:03:32 devstack cinder-volume[81422]: INFO cinder.volume.manager [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Determined volume DB was empty at startup. Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG cinder.volume.manager [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81422) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 11 05:03:32 devstack cinder-volume[81422]: INFO cinder.volume.manager [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 11 05:03:32 devstack cinder-volume[81422]: WARNING stevedore.named [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 11 05:03:32 devstack cinder-volume[81422]: WARNING castellan.key_manager [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 11 05:03:32 devstack cinder-volume[81422]: WARNING cinder.keymgr.conf_key_mgr [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG cinder.volume.drivers.lvm [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=81422) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_concurrency.processutils [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=81422) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_concurrency.processutils [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.375s {{(pid=81422) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_db.sqlalchemy.engines [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81422) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 11 05:03:32 devstack cinder-volume[81422]: INFO cinder.rpc [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 11 05:03:32 devstack cinder-volume[81422]: INFO cinder.rpc [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 11 05:03:32 devstack cinder-volume[81422]: WARNING stevedore.named [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 11 05:03:32 devstack cinder-volume[81422]: WARNING castellan.key_manager [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 11 05:03:32 devstack cinder-volume[81422]: INFO cinder.volume.manager [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_db.sqlalchemy.engines [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81422) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 11 05:03:32 devstack cinder-volume[81422]: INFO oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Starting 1 workers Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Started child 81584 {{(pid=81422) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Full set of CONF: {{(pid=81422) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] ******************************************************************************** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Configuration options gathered from: {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] ================================================================================ {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] allow_availability_zone_fallback = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] allow_compression_on_image_upload = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] allowed_direct_url_schemes = [] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] api_rate_limit = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] auth_strategy = keystone {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] az_cache_duration = 3600 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_availability_zone = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_host = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_name = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_stats_polling_interval = 60 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backup_api_class = cinder.backup.api.API {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backup_name_template = backup-%s {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backup_use_same_host = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backup_use_temp_snapshot = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] chap_password = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] chap_username = {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81584]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cinder_internal_tenant_project_id = bb414a05e85e4491801027bba83815ad {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cinder_internal_tenant_user_id = f6dba2ca779d419ea5eac90d1c62464f {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cloned_volume_same_az = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cluster = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] compression_format = gzip {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] compute_api_class = cinder.compute.nova.API {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] config_dir = [] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] config_source = [] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] control_exchange = openstack {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] debug = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] default_availability_zone = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] default_group_type = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] default_volume_type = lvmdriver-1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] disk_geometry = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] driver_client_cert = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] driver_client_cert_key = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] driver_data_namespace = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] driver_ssl_cert_path = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] driver_ssl_cert_verify = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] driver_use_ssl = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] enable_force_upload = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] enable_new_services = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] enable_unsupported_driver = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] enforce_multipath_for_image_xfer = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] filter_function = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance_api_insecure = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance_api_ssl_compression = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance_ca_certificates_file = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance_catalog_info = image:glance:publicURL {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance_certfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance_keyfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance_num_retries = 3 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance_request_timeout = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] goodness_function = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] graceful_shutdown_timeout = 5 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] group_api_class = cinder.group.api.API {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] host = devstack {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] image_compress_on_upload = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] image_conversion_address_space_limit = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] image_conversion_cpu_limit = 60 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] image_conversion_disable = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] image_upload_use_cinder_backend = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] image_upload_use_internal_tenant = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] image_volume_cache_enabled = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] image_volume_cache_max_count = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] image_volume_cache_max_size_gb = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] init_host_max_objects_retrieval = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] instance_format = [instance: %(uuid)s] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] iscsi_target_flags = {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] iscsi_write_cache = on {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] iser_helper = tgtadm {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] iser_ip_address = 192.168.122.208 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] iser_port = 3260 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] log_color = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] log_config_append = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] log_dir = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] log_file = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] log_options = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] log_rotate_interval = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] log_rotate_interval_type = days {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] log_rotation_type = none {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] max_age = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] max_logfile_count = 30 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] max_logfile_size_mb = 200 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] max_over_subscription_ratio = 20.0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] message_reap_interval = 86400 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] message_ttl = 2592000 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] migration_create_volume_timeout_secs = 300 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] monkey_patch = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] monkey_patch_modules = [] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] my_ip = 192.168.122.208 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] no_snapshot_gb_quota = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] num_iser_scan_tries = 3 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] num_shell_tries = 3 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] num_volume_device_scan_tries = 3 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] nvmeof_conn_info_version = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] nvmet_ns_id = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] nvmet_port_id = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] osapi_max_limit = 1000 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] osapi_volume_ext_list = [] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] osapi_volume_listen_port = 8776 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] osapi_volume_use_ssl = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] osapi_volume_workers = 2 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] per_volume_size_limit = -1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] periodic_fuzzy_delay = 60 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] periodic_interval = 60 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] public_endpoint = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] publish_errors = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] quota_backup_gigabytes = 1000 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] quota_backups = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] quota_gigabytes = 1000 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] quota_groups = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] quota_snapshots = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] quota_volumes = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] rate_limit_burst = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] rate_limit_except_level = CRITICAL {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] rate_limit_interval = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] reinit_driver_count = 3 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] replication_device = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] report_discard_supported = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] report_interval = 120 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] reservation_clean_interval = 86400 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] reservation_expire = 86400 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] reserved_image_namespaces = [] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] reserved_percentage = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] rpc_response_timeout = 120 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] run_external_periodic_tasks = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] scst_target_driver = iscsi {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] scst_target_iqn_name = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] service_down_time = 720 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] shell_completion = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81584]: INFO cinder.volume.manager [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 11 05:03:32 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] snapshot_name_template = snapshot-%s {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] snapshot_same_host = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] split_loggers = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] state_path = /opt/stack/data/cinder {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] storage_availability_zone = nova {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] storage_protocol = iSCSI {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] syslog_log_facility = LOG_USER {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] target_helper = lioadm {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] target_ip_address = 192.168.122.208 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] target_port = 3260 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] target_protocol = iscsi {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] target_secondary_ip_addresses = [] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] trace_flags = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] transport_url = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] until_refresh = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] use_chap_auth = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] use_default_quota_class = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] use_journal = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] use_json = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] use_multipath_for_image_xfer = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] use_stderr = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] use_syslog = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] verify_glance_signatures = enabled {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] volume_api_class = cinder.volume.api.API {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] volume_backend_name = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] volume_clear = zero {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] volume_clear_ionice = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] volume_clear_size = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] volume_copy_bps_limit = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] volume_dd_blocksize = 1M {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] volume_name_template = volume-%s {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] volume_service_inithost_offload = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] volume_usage_audit_period = month {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] zoning_mode = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_concurrency.disable_process_locking = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.admin_password = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.admin_token = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.admin_user = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.auth_port = 35357 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.auth_protocol = https {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.auth_section = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.auth_type = password {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.auth_uri = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.auth_version = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.cache = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.certfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.identity_uri = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.include_service_catalog = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.insecure = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.interface = public {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.keyfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_password = {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcache_username = {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.region_name = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.service_type = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.backend = dogpile.cache.null {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.backend_argument = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.backend_expiration_time = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.config_prefix = cache.oslo {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.debug_cache_backend = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.enable_retry_client = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.enable_socket_keepalive = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.enabled = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.enforce_fips_mode = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.expiration_time = 600 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.hashclient_retry_attempts = 2 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.memcache_dead_retry = 300 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.memcache_pool_maxsize = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.memcache_sasl_enabled = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.password = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.proxies = [] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.redis_db = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.redis_server = localhost:6379 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.retry_attempts = 2 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.retry_delay = 0.0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.socket_keepalive_count = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.socket_keepalive_idle = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.socket_keepalive_interval = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.socket_timeout = 1.0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.tls_allowed_ciphers = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.tls_cafile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.tls_certfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.tls_enabled = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.tls_keyfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cache.username = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.asyncio_connection = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.asyncio_slave_connection = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.backend = sqlalchemy {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.connection = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.connection_debug = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.connection_parameters = {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.connection_recycle_time = 3600 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.connection_trace = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.db_inc_retry_interval = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:32 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.db_max_retries = 20 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.db_max_retry_interval = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.db_retry_interval = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.max_overflow = 50 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.max_pool_size = 5 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.max_retries = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.mysql_wsrep_sync_wait = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.pool_timeout = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.retry_interval = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.slave_connection = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.sqlite_synchronous = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.synchronous_reader = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] database.use_db_reconnect = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler.connection_string = messaging:// {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler.enabled = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler.es_doc_type = notification {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler.es_scroll_size = 10000 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler.es_scroll_time = 2m {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler.filter_error_trace = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler.hmac_keys = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler.sentinel_service_name = mymaster {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler.socket_timeout = 0.1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler.trace_requests = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler.trace_sqlalchemy = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler_jaeger.process_tags = {} {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler_jaeger.service_name_prefix = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] profiler_otlp.service_name_prefix = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_policy.enforce_new_defaults = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: WARNING oslo_config.cfg [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_policy.enforce_scope = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_policy.policy_default_rule = default {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_policy.policy_file = policy.yaml {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] coordination.backend_url = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] privsep_osbrick.group = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] privsep_osbrick.helper_command = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] privsep_osbrick.user = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cinder_sys_admin.group = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cinder_sys_admin.helper_command = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] cinder_sys_admin.user = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] service_user.auth_section = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] service_user.auth_type = password {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] service_user.cafile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] service_user.certfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] service_user.collect_timing = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] service_user.insecure = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] service_user.keyfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] service_user.send_service_user_token = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] service_user.split_loggers = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] service_user.timeout = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance.auth_section = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance.auth_type = password {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance.certfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance.collect_timing = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance.insecure = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance.keyfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance.region_name = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance.split_loggers = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] glance.timeout = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.backend_availability_zone = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.chap_password = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.chap_username = {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.disk_geometry = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.driver_client_cert = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.driver_client_cert_key = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.driver_data_namespace = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.driver_use_ssl = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.extra_capabilities = {} {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.filter_function = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.goodness_function = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.iscsi_target_flags = {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.iscsi_write_cache = on {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.iser_helper = tgtadm {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.iser_port = 3260 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.lvm_share_target = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.lvm_type = auto {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.num_shell_tries = 3 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.replication_device = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.report_discard_supported = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.reserved_percentage = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack sudo[81596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.target_helper = tgtadm {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack sudo[81596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.target_port = 3260 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.target_protocol = iscsi {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.trace_flags = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.unique_fqdn_network = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.use_chap_auth = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.volume_backend_name = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.volume_clear = zero {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.volume_clear_ionice = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.volume_clear_size = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_reports.file_event_handler = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_reports.log_dir = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.backend_host = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.chap_password = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.chap_username = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.disk_geometry = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.driver_client_cert = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.extra_capabilities = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.filter_function = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.goodness_function = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.iser_helper = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.iser_ip_address = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.iser_port = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.lvm_share_target = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.lvm_type = auto {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.num_shell_tries = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.replication_device = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.report_discard_supported = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.reserved_percentage = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.scst_target_driver = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.storage_protocol = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.target_helper = lioadm {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.target_ip_address = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.target_port = 3260 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.trace_flags = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.use_chap_auth = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.volume_clear = zero {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.volume_clear_size = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] lvmdriver-1.volumes_dir = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.ssl = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_notifications.driver = [] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_notifications.retry = -1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] key_manager.fixed_key = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.barbican_api_version = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.barbican_endpoint = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.barbican_endpoint_type = public {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.barbican_region_name = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.cafile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.certfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.collect_timing = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.insecure = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.keyfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.number_of_retries = 60 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.retry_delay = 1 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.send_service_user_token = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.split_loggers = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.timeout = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.verify_ssl = True {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican.verify_ssl_path = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican_service_user.auth_section = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican_service_user.auth_type = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican_service_user.cafile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican_service_user.certfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican_service_user.collect_timing = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican_service_user.insecure = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican_service_user.keyfile = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican_service_user.split_loggers = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] barbican_service_user.timeout = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] vault.approle_role_id = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] vault.approle_secret_id = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] vault.kv_mountpoint = secret {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] vault.kv_path = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] vault.kv_version = 2 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] vault.namespace = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] vault.root_token_id = **** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] vault.ssl_ca_crt_file = None {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] vault.timeout = 60.0 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] vault.use_ssl = False {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:03:32 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] ******************************************************************************** {{(pid=81422) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 11 05:03:33 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.722s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:33 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:33 devstack sudo[81596]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:33 devstack sudo[81605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 11 05:03:33 devstack sudo[81605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:34 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.674s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:34 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:03:34 devstack cinder-volume[81584]: INFO cinder.brick.local_dev.lvm [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 11 05:03:34 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:34 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:34 devstack sudo[81605]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:34 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:34 devstack sudo[81766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 11 05:03:34 devstack sudo[81766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:34 devstack sudo[81766]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:34 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:34 devstack cinder-volume[81584]: DEBUG cinder.brick.local_dev.lvm [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=81584) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 11 05:03:34 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:34 devstack sudo[81968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 11 05:03:34 devstack sudo[81968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:36 devstack sudo[81968]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:36 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.834s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:36 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:36 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:36 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:36 devstack sudo[82365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 11 05:03:36 devstack sudo[82365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:37 devstack sudo[82365]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:37 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.801s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:37 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:37 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:37 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:37 devstack sudo[82377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 11 05:03:37 devstack sudo[82377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:38 devstack sudo[82377]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:38 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.739s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:38 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:38 devstack sudo[82381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 11 05:03:38 devstack sudo[82381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:38 devstack sudo[82381]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:38 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:38 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:38 devstack sudo[82386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 11 05:03:38 devstack sudo[82386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:39 devstack sudo[82386]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:39 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:39 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:39 devstack sudo[82389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:03:39 devstack sudo[82389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:40 devstack sudo[82389]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:40 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:40 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:40 devstack sudo[82394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 11 05:03:40 devstack sudo[82394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:40 devstack sudo[82394]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:40 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.664s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:40 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:40 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:40 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:40 devstack sudo[82402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 11 05:03:40 devstack sudo[82402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:41 devstack sudo[82402]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:41 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.967s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:41 devstack cinder-volume[81584]: INFO cinder.volume.drivers.lvm [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 11 05:03:41 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:41 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:41 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:41 devstack sudo[82412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 11 05:03:41 devstack sudo[82412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:42 devstack cinder-volume[81422]: DEBUG dbcounter [-] [81422] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81422) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:03:42 devstack sudo[82412]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:42 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.784s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:42 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.lvm [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Updating volume stats {{(pid=81584) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 11 05:03:42 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:42 devstack sudo[82535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 11 05:03:42 devstack sudo[82535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:43 devstack sudo[82535]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:43 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:43 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:43 devstack sudo[82667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:03:43 devstack sudo[82667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:43 devstack sudo[82667]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:43 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:43 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:43 devstack sudo[82674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 11 05:03:43 devstack sudo[82674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:44 devstack sudo[82674]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:44 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.613s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:44 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:44 devstack sudo[82677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:03:44 devstack sudo[82677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:45 devstack sudo[82677]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:45 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.591s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:45 devstack cinder-volume[81584]: INFO cinder.volume.driver [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Driver hasn't implemented _init_vendor_properties() Jun 11 05:03:45 devstack cinder-volume[81584]: DEBUG cinder.volume.driver [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81584) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 11 05:03:45 devstack cinder-volume[81584]: DEBUG oslo_db.sqlalchemy.engines [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81584) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 11 05:03:45 devstack cinder-volume[81584]: DEBUG dbcounter [-] [81584] Writer thread running {{(pid=81584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 11 05:03:45 devstack cinder-volume[81584]: DEBUG cinder.db.sqlalchemy.api [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Building query based on filter {{(pid=81584) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 11 05:03:45 devstack cinder-volume[81584]: DEBUG cinder.image.image_utils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81584) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 11 05:03:45 devstack cinder-volume[81584]: INFO cinder.keymgr.migration [None req-b9729997-b780-4ebc-b265-ab323ada37f4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 11 05:03:45 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.lvm [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Updating volume stats {{(pid=81584) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 11 05:03:45 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:45 devstack sudo[82681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 11 05:03:45 devstack sudo[82681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:45 devstack sudo[82681]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:45 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:45 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:45 devstack sudo[82684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:03:45 devstack sudo[82684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:46 devstack sudo[82684]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:46 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:46 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:46 devstack sudo[82687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 11 05:03:46 devstack sudo[82687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:47 devstack sudo[82687]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:47 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:47 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:47 devstack sudo[82694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:03:47 devstack sudo[82694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:47 devstack sudo[82694]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:47 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:47 devstack cinder-volume[81584]: DEBUG cinder.manager [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Notifying Schedulers of capabilities ... {{(pid=81584) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:03:47 devstack cinder-volume[81584]: INFO cinder.volume.manager [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Driver initialization completed successfully. Jun 11 05:03:47 devstack cinder-volume[81584]: INFO cinder.manager [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Initiating service 2 cleanup Jun 11 05:03:47 devstack cinder-volume[81584]: INFO cinder.manager [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Service 2 cleanup completed. Jun 11 05:03:47 devstack cinder-volume[81584]: DEBUG cinder.service [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Creating RPC server for service cinder-volume {{(pid=81584) start /opt/stack/cinder/cinder/service.py:231}} Jun 11 05:03:47 devstack cinder-volume[81584]: DEBUG cinder.service [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81584) start /opt/stack/cinder/cinder/service.py:237}} Jun 11 05:03:47 devstack cinder-volume[81584]: INFO cinder.volume.manager [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 11 05:03:47 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.lvm [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Updating volume stats {{(pid=81584) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 11 05:03:47 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:47 devstack sudo[82699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 11 05:03:47 devstack sudo[82699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:48 devstack sudo[82699]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:48 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:48 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:48 devstack sudo[82702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:03:48 devstack sudo[82702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:49 devstack sudo[82702]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:49 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:49 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:49 devstack sudo[82758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 11 05:03:49 devstack sudo[82758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:49 devstack sudo[82758]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:49 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.611s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:49 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:03:49 devstack sudo[82762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:03:49 devstack sudo[82762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:03:50 devstack sudo[82762]: pam_unix(sudo:session): session closed for user root Jun 11 05:03:50 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:03:50 devstack cinder-volume[81584]: INFO cinder.volume.manager [None req-c7672f52-0015-4672-a4f1-32b8110eba04 None None] Driver post RPC initialization completed successfully. Jun 11 05:03:57 devstack cinder-volume[81584]: DEBUG oslo_service.periodic_task [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running periodic task VolumeManager._thread_info {{(pid=81584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:03:57 devstack cinder-volume[81584]: DEBUG cinder.volume.manager [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] thread count: 6 {{(pid=81584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:03:57 devstack cinder-volume[81584]: DEBUG cinder.volume.manager [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] thread info: [<_MainThread(MainThread, started 131273253716096)>, , , , , ] {{(pid=81584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:03:57 devstack cinder-volume[81584]: DEBUG dbcounter [-] [81584] Writing DB stats cinder:SELECT=4 {{(pid=81584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:04:00 devstack cinder-volume[81584]: DEBUG dbcounter [-] [81584] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=81584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:04:57 devstack cinder-volume[81584]: DEBUG oslo_service.periodic_task [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:04:57 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.lvm [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Updating volume stats {{(pid=81584) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 11 05:04:57 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:04:57 devstack sudo[84961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 11 05:04:57 devstack sudo[84961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:04:58 devstack sudo[84961]: pam_unix(sudo:session): session closed for user root Jun 11 05:04:58 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:04:58 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:04:58 devstack sudo[84964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:04:58 devstack sudo[84964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:04:58 devstack sudo[84964]: pam_unix(sudo:session): session closed for user root Jun 11 05:04:58 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.571s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:04:58 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:04:58 devstack sudo[84970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 11 05:04:58 devstack sudo[84970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:04:59 devstack sudo[84970]: pam_unix(sudo:session): session closed for user root Jun 11 05:04:59 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.596s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:04:59 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:04:59 devstack sudo[84973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:04:59 devstack sudo[84973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:04:59 devstack sudo[84973]: pam_unix(sudo:session): session closed for user root Jun 11 05:04:59 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:04:59 devstack cinder-volume[81584]: DEBUG cinder.manager [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Notifying Schedulers of capabilities ... {{(pid=81584) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:04:59 devstack cinder-volume[81584]: DEBUG oslo_service.periodic_task [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running periodic task VolumeManager._thread_info {{(pid=81584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:04:59 devstack cinder-volume[81584]: DEBUG cinder.volume.manager [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] thread count: 6 {{(pid=81584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:04:59 devstack cinder-volume[81584]: DEBUG cinder.volume.manager [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] thread info: [<_MainThread(MainThread, started 131273253716096)>, , , , , ] {{(pid=81584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:05:57 devstack cinder-volume[81584]: DEBUG oslo_service.periodic_task [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:05:57 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.lvm [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Updating volume stats {{(pid=81584) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 11 05:05:57 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:05:57 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 11 05:05:57 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:05:57 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Jun 11 05:05:57 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.562s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:05:57 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:05:57 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:05:57 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:05:58 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Jun 11 05:05:58 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.571s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:05:58 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:05:58 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 11 05:05:58 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:05:59 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Jun 11 05:05:59 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.560s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:05:59 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:05:59 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:05:59 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:05:59 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Jun 11 05:05:59 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:05:59 devstack cinder-volume[81584]: DEBUG cinder.manager [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Notifying Schedulers of capabilities ... {{(pid=81584) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:05:59 devstack cinder-volume[81584]: DEBUG oslo_service.periodic_task [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running periodic task VolumeManager._thread_info {{(pid=81584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:05:59 devstack cinder-volume[81584]: DEBUG cinder.volume.manager [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] thread count: 6 {{(pid=81584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:05:59 devstack cinder-volume[81584]: DEBUG cinder.volume.manager [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] thread info: [<_MainThread(MainThread, started 131273253716096)>, , , , , ] {{(pid=81584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:06:00 devstack cinder-volume[81584]: DEBUG dbcounter [-] [81584] Writing DB stats cinder:SELECT=1 {{(pid=81584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:06:00 devstack cinder-volume[81584]: DEBUG dbcounter [-] [81584] Writing DB stats cinder:UPDATE=1 {{(pid=81584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:06:57 devstack cinder-volume[81584]: DEBUG oslo_service.periodic_task [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:06:57 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.lvm [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Updating volume stats {{(pid=81584) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 11 05:06:57 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:06:57 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 11 05:06:57 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:06:58 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Jun 11 05:06:58 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:06:58 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:06:58 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:06:58 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:06:58 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Jun 11 05:06:58 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:06:58 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:06:58 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 11 05:06:58 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:06:59 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Jun 11 05:06:59 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.580s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:06:59 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:06:59 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:06:59 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:06:59 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Jun 11 05:06:59 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.559s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:06:59 devstack cinder-volume[81584]: DEBUG cinder.manager [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Notifying Schedulers of capabilities ... {{(pid=81584) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:06:59 devstack cinder-volume[81584]: DEBUG oslo_service.periodic_task [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running periodic task VolumeManager._thread_info {{(pid=81584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:06:59 devstack cinder-volume[81584]: DEBUG cinder.volume.manager [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] thread count: 6 {{(pid=81584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:06:59 devstack cinder-volume[81584]: DEBUG cinder.volume.manager [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] thread info: [<_MainThread(MainThread, started 131273253716096)>, , , , , ] {{(pid=81584) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:07:57 devstack cinder-volume[81584]: DEBUG oslo_service.periodic_task [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81584) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:07:57 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.lvm [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Updating volume stats {{(pid=81584) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 11 05:07:57 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:07:57 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 11 05:07:57 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:07:57 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Jun 11 05:07:57 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:07:57 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:07:58 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:07:58 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:07:58 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Jun 11 05:07:58 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:07:58 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:07:58 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 11 05:07:58 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:07:59 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Jun 11 05:07:59 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.579s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:07:59 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:07:59 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 11 05:07:59 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:07:59 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Jun 11 05:07:59 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:07:59 devstack cinder-volume[81584]: DEBUG cinder.manager [None req-da917a10-b33f-4fc5-9529-3a6b1caaecd7 None None] Notifying Schedulers of capabilities ... {{(pid=81584) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:08:00 devstack cinder-volume[81584]: DEBUG dbcounter [-] [81584] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=81584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:08:09 devstack cinder-volume[81422]: INFO oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Caught SIGTERM, stopping children Jun 11 05:08:09 devstack cinder-volume[81422]: DEBUG oslo_concurrency.lockutils [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Acquiring lock "singleton_lock" {{(pid=81422) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 11 05:08:09 devstack cinder-volume[81422]: DEBUG oslo_concurrency.lockutils [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Acquired lock "singleton_lock" {{(pid=81422) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 11 05:08:09 devstack cinder-volume[81422]: DEBUG oslo_concurrency.lockutils [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Releasing lock "singleton_lock" {{(pid=81422) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 11 05:08:09 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Stop services. {{(pid=81422) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 11 05:08:09 devstack cinder-volume[81422]: DEBUG oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Killing children. {{(pid=81422) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 11 05:08:09 devstack cinder-volume[81422]: INFO oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Waiting on 1 children to exit Jun 11 05:08:12 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Acquiring lock "singleton_lock" {{(pid=81584) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 11 05:08:12 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Acquired lock "singleton_lock" {{(pid=81584) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 11 05:08:12 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Releasing lock "singleton_lock" {{(pid=81584) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 11 05:08:12 devstack cinder-volume[81584]: WARNING amqp [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 11 05:08:12 devstack cinder-volume[81584]: WARNING amqp [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 11 05:08:12 devstack cinder-volume[81422]: INFO oslo_service.backend._eventlet.service [None req-91983822-e07b-4275-a1dc-fada1e758bf2 None None] Child 81584 exited with status 0 Jun 11 05:08:15 devstack cinder-volume[91329]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 11 05:08:15 devstack cinder-volume[91329]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 11 05:08:15 devstack cinder-volume[91329]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 11 05:08:15 devstack cinder-volume[91329]: INFO dbcounter [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Registered counter for database cinder Jun 11 05:08:15 devstack cinder-volume[91329]: DEBUG oslo_db.sqlalchemy.engines [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 11 05:08:15 devstack cinder-volume[91329]: DEBUG dbcounter [-] [91329] Writer thread running {{(pid=91329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 11 05:08:15 devstack cinder-volume[91329]: INFO cinder.rpc [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 11 05:08:15 devstack cinder-volume[91329]: INFO cinder.rpc [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 11 05:08:15 devstack cinder-volume[91329]: DEBUG oslo_db.sqlalchemy.engines [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 11 05:08:16 devstack cinder-volume[91329]: INFO cinder.volume.manager [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Determined volume DB was empty at startup. Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG cinder.volume.manager [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91329) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 11 05:08:16 devstack cinder-volume[91329]: INFO cinder.volume.manager [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 11 05:08:16 devstack cinder-volume[91329]: WARNING stevedore.named [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 11 05:08:16 devstack cinder-volume[91329]: WARNING castellan.key_manager [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 11 05:08:16 devstack cinder-volume[91329]: WARNING cinder.keymgr.conf_key_mgr [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 11 05:08:16 devstack cinder-volume[91329]: INFO cinder.volume.manager [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_db.sqlalchemy.engines [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 11 05:08:16 devstack cinder-volume[91329]: INFO oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Starting 1 workers Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Started child 91466 {{(pid=91329) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Full set of CONF: {{(pid=91329) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] ******************************************************************************** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Configuration options gathered from: {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] ================================================================================ {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] allow_availability_zone_fallback = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] allow_compression_on_image_upload = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] allowed_direct_url_schemes = [] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] api_rate_limit = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] auth_strategy = keystone {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_availability_zone = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_host = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_name = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_stats_polling_interval = 60 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backup_api_class = cinder.backup.api.API {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backup_name_template = backup-%s {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backup_use_same_host = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backup_use_temp_snapshot = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] chap_password = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] chap_username = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cinder_internal_tenant_project_id = bb414a05e85e4491801027bba83815ad {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cinder_internal_tenant_user_id = f6dba2ca779d419ea5eac90d1c62464f {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cluster = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] compression_format = gzip {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] compute_api_class = cinder.compute.nova.API {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] config_dir = [] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] config_source = [] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] control_exchange = openstack {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] debug = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] default_availability_zone = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] default_group_type = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] default_volume_type = QuobyteHD {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] disk_geometry = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] driver_client_cert = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] driver_client_cert_key = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] driver_data_namespace = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91466]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] driver_ssl_cert_path = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] driver_ssl_cert_verify = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] driver_use_ssl = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] enable_new_services = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] enable_unsupported_driver = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] enabled_backends = ['QuobyteHD'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] enforce_multipath_for_image_xfer = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] filter_function = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance_api_insecure = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance_api_ssl_compression = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance_ca_certificates_file = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance_catalog_info = image:glance:publicURL {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance_certfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance_keyfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance_num_retries = 3 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance_request_timeout = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] goodness_function = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] graceful_shutdown_timeout = 5 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] group_api_class = cinder.group.api.API {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] host = devstack {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] image_compress_on_upload = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] image_conversion_address_space_limit = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] image_conversion_cpu_limit = 60 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] image_conversion_disable = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] image_upload_use_cinder_backend = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] image_upload_use_internal_tenant = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] image_volume_cache_enabled = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] image_volume_cache_max_count = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] image_volume_cache_max_size_gb = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] init_host_max_objects_retrieval = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] instance_format = [instance: %(uuid)s] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] iscsi_target_flags = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] iscsi_write_cache = on {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] iser_helper = tgtadm {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] iser_ip_address = 192.168.122.208 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] iser_port = 3260 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] log_color = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] log_config_append = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] log_dir = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] log_file = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] log_options = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] log_rotate_interval = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] log_rotate_interval_type = days {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] log_rotation_type = none {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] max_age = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] max_logfile_count = 30 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] max_logfile_size_mb = 200 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] max_over_subscription_ratio = 20.0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] message_reap_interval = 86400 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] message_ttl = 2592000 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] migration_create_volume_timeout_secs = 300 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] monkey_patch = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] monkey_patch_modules = [] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] my_ip = 192.168.122.208 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] no_snapshot_gb_quota = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] num_iser_scan_tries = 3 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] num_shell_tries = 3 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] num_volume_device_scan_tries = 3 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] nvmeof_conn_info_version = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] nvmet_ns_id = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] nvmet_port_id = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] osapi_max_limit = 1000 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] osapi_volume_ext_list = [] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] osapi_volume_listen_port = 8776 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] osapi_volume_use_ssl = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] osapi_volume_workers = 2 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] per_volume_size_limit = -1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] periodic_fuzzy_delay = 60 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] periodic_interval = 60 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] public_endpoint = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] publish_errors = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] quota_backup_gigabytes = 1000 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] quota_backups = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] quota_gigabytes = 1000 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] quota_groups = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] quota_snapshots = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] quota_volumes = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] rate_limit_burst = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] rate_limit_except_level = CRITICAL {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] rate_limit_interval = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] reinit_driver_count = 3 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] replication_device = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] report_discard_supported = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] report_interval = 120 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] reservation_clean_interval = 86400 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] reservation_expire = 86400 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] reserved_image_namespaces = [] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] reserved_percentage = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] rpc_response_timeout = 120 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] run_external_periodic_tasks = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] scst_target_driver = iscsi {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] scst_target_iqn_name = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] service_down_time = 720 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] shell_completion = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] snapshot_name_template = snapshot-%s {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] split_loggers = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] state_path = /opt/stack/data/cinder {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] storage_availability_zone = nova {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] storage_protocol = iSCSI {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] syslog_log_facility = LOG_USER {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] target_helper = lioadm {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] target_ip_address = 192.168.122.208 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] target_port = 3260 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] target_protocol = iscsi {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] target_secondary_ip_addresses = [] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] trace_flags = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] transport_url = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] until_refresh = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] use_chap_auth = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] use_default_quota_class = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] use_journal = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] use_json = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] use_multipath_for_image_xfer = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] use_stderr = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] use_syslog = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] verify_glance_signatures = enabled {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] volume_api_class = cinder.volume.api.API {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] volume_backend_name = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] volume_clear = zero {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] volume_clear_ionice = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] volume_clear_size = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] volume_copy_bps_limit = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] volume_dd_blocksize = 1M {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] volume_name_template = volume-%s {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] volume_service_inithost_offload = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] volume_usage_audit_period = month {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] zoning_mode = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_concurrency.disable_process_locking = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.admin_password = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.admin_token = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.admin_user = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.auth_admin_prefix = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.auth_port = 35357 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.auth_protocol = https {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.auth_section = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.auth_type = password {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.auth_uri = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.auth_version = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.cache = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.certfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.identity_uri = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.include_service_catalog = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.insecure = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.interface = public {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.keyfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_password = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcache_username = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.region_name = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.service_token_roles_required = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.service_type = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.backend = dogpile.cache.null {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.backend_argument = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.backend_expiration_time = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.config_prefix = cache.oslo {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.debug_cache_backend = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.enable_retry_client = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.enable_socket_keepalive = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.enabled = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.enforce_fips_mode = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.expiration_time = 600 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.hashclient_retry_attempts = 2 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.memcache_dead_retry = 300 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.memcache_pool_maxsize = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.memcache_sasl_enabled = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.password = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.proxies = [] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.redis_db = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.redis_server = localhost:6379 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.retry_attempts = 2 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91466]: INFO cinder.volume.manager [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.retry_delay = 0.0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.socket_keepalive_count = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.socket_keepalive_idle = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.socket_keepalive_interval = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.socket_timeout = 1.0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.tls_allowed_ciphers = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.tls_cafile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.tls_certfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.tls_enabled = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.tls_keyfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cache.username = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.asyncio_connection = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.asyncio_slave_connection = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.backend = sqlalchemy {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.connection = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.connection_debug = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.connection_parameters = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.connection_recycle_time = 3600 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.connection_trace = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.db_inc_retry_interval = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.db_max_retries = 20 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91466]: DEBUG cinder.volume.drivers.remotefs [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91466) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.db_max_retry_interval = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.db_retry_interval = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.max_overflow = 50 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.max_pool_size = 5 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.max_retries = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.mysql_wsrep_sync_wait = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.pool_timeout = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.retry_interval = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.slave_connection = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.sqlite_synchronous = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.synchronous_reader = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] database.use_db_reconnect = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler.connection_string = messaging:// {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler.enabled = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler.es_doc_type = notification {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler.es_scroll_size = 10000 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler.es_scroll_time = 2m {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler.filter_error_trace = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler.hmac_keys = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler.sentinel_service_name = mymaster {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler.socket_timeout = 0.1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler.trace_requests = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler.trace_sqlalchemy = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler_jaeger.process_tags = {} {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler_jaeger.service_name_prefix = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] profiler_otlp.service_name_prefix = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_policy.enforce_new_defaults = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: WARNING oslo_config.cfg [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_policy.enforce_scope = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_policy.policy_default_rule = default {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_policy.policy_file = policy.yaml {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] coordination.backend_url = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] privsep_osbrick.group = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] privsep_osbrick.helper_command = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] privsep_osbrick.user = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cinder_sys_admin.group = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cinder_sys_admin.helper_command = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] cinder_sys_admin.user = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] service_user.auth_section = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] service_user.auth_type = password {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] service_user.cafile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] service_user.certfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] service_user.collect_timing = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] service_user.insecure = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] service_user.keyfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] service_user.send_service_user_token = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] service_user.split_loggers = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] service_user.timeout = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance.auth_section = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance.auth_type = password {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance.certfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance.collect_timing = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance.insecure = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance.keyfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance.region_name = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance.split_loggers = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] glance.timeout = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.backend_availability_zone = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.chap_password = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.chap_username = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.disk_geometry = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.driver_client_cert = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.driver_client_cert_key = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.driver_data_namespace = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.driver_use_ssl = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.extra_capabilities = {} {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.filter_function = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.goodness_function = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.iscsi_target_flags = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.iscsi_write_cache = on {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.iser_helper = tgtadm {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.iser_port = 3260 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.nas_host = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.nas_login = admin {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.nas_mount_options = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.nas_password = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.nas_private_key = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.nas_share_path = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.num_shell_tries = 3 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.quobyte_volume_url = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.replication_device = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.report_discard_supported = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.reserved_percentage = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.target_helper = tgtadm {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.target_port = 3260 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.target_protocol = iscsi {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.trace_flags = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.unique_fqdn_network = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.use_chap_auth = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.volume_backend_name = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.volume_clear = zero {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.volume_clear_ionice = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.volume_clear_size = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_reports.file_event_handler = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_reports.log_dir = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.backend_availability_zone = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.backend_host = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.chap_password = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.chap_username = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.chiscsi_conf = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.disk_geometry = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.driver_client_cert = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.driver_data_namespace = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.driver_use_ssl = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.extra_capabilities = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.filter_function = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.goodness_function = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.iser_helper = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.iser_ip_address = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.iser_port = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.iser_target_prefix = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.nas_host = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.nas_login = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.nas_mount_options = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.nas_password = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.nas_private_key = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.nas_share_path = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.nas_ssh_port = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.num_shell_tries = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.nvmet_port_id = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.replication_device = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.report_discard_supported = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.reserved_percentage = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.scst_target_driver = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.storage_protocol = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.target_helper = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.target_ip_address = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.target_port = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.target_prefix = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.target_protocol = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.trace_flags = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.use_chap_auth = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.volume_clear = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.volume_clear_size = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] QuobyteHD.volumes_dir = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.ssl = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_notifications.driver = [] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_notifications.retry = -1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] key_manager.fixed_key = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.barbican_api_version = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.barbican_endpoint = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.barbican_endpoint_type = public {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.barbican_region_name = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.cafile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.certfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.collect_timing = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.insecure = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.keyfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.number_of_retries = 60 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.retry_delay = 1 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.send_service_user_token = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.split_loggers = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.timeout = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.verify_ssl = True {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican.verify_ssl_path = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican_service_user.auth_section = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican_service_user.auth_type = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican_service_user.cafile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican_service_user.certfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican_service_user.collect_timing = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican_service_user.insecure = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican_service_user.keyfile = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican_service_user.split_loggers = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] barbican_service_user.timeout = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] vault.approle_role_id = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] vault.approle_secret_id = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] vault.kv_mountpoint = secret {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] vault.kv_path = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] vault.kv_version = 2 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] vault.namespace = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] vault.root_token_id = **** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] vault.ssl_ca_crt_file = None {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] vault.timeout = 60.0 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] vault.use_ssl = False {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:16 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] ******************************************************************************** {{(pid=91329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 11 05:08:16 devstack cinder-volume[91466]: DEBUG cinder.volume.drivers.quobyte [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91466) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 11 05:08:16 devstack cinder-volume[91466]: WARNING cinder.volume.drivers.quobyte [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 11 05:08:16 devstack cinder-volume[91466]: WARNING cinder.volume.drivers.quobyte [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 11 05:08:16 devstack cinder-volume[91466]: DEBUG oslo_concurrency.processutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Running cmd (subprocess): mount.quobyte {{(pid=91466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:08:16 devstack quobyte-client[91546]: Reading configuration file: /etc/quobyte/client.cfg Jun 11 05:08:16 devstack quobyte-client[91546]: Invalid parameters found, error: missing mount point. Jun 11 05:08:16 devstack quobyte-client[91546]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 11 05:08:16 devstack quobyte-client[91546]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 11 05:08:16 devstack cinder-volume[91466]: DEBUG oslo_concurrency.processutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] CMD "mount.quobyte" returned: 1 in 0.105s {{(pid=91466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:08:16 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:08:16 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:08:16 devstack cinder-volume[91466]: DEBUG cinder.volume.drivers.quobyte [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=91466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:08:16 devstack cinder-volume[91466]: INFO cinder.volume.drivers.quobyte [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 ... Jun 11 05:08:16 devstack cinder-volume[91466]: DEBUG oslo_concurrency.processutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b -c /etc/quobyte/client-cinder.cfg {{(pid=91466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:08:16 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b -c /etc/quobyte/client-cinder.cfg Jun 11 05:08:16 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:08:17 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Jun 11 05:08:17 devstack cinder-volume[91466]: DEBUG oslo_concurrency.processutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.773s {{(pid=91466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:08:17 devstack cinder-volume[91466]: INFO cinder.volume.drivers.quobyte [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 succeeded Jun 11 05:08:17 devstack cinder-volume[91466]: DEBUG cinder.volume.drivers.quobyte [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=91466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:08:17 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.784s {{(pid=91466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:08:17 devstack cinder-volume[91466]: DEBUG oslo_concurrency.processutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=91466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:08:17 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:08:17 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:08:17 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Jun 11 05:08:17 devstack cinder-volume[91466]: DEBUG oslo_concurrency.processutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.574s {{(pid=91466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:08:17 devstack cinder-volume[91466]: INFO cinder.volume.driver [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Driver hasn't implemented _init_vendor_properties() Jun 11 05:08:17 devstack cinder-volume[91466]: DEBUG cinder.volume.driver [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91466) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG oslo_db.sqlalchemy.engines [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91466) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG dbcounter [-] [91466] Writer thread running {{(pid=91466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG cinder.db.sqlalchemy.api [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Building query based on filter {{(pid=91466) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG cinder.image.image_utils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91466) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 11 05:08:18 devstack cinder-volume[91466]: INFO cinder.keymgr.migration [None req-cb7db31e-180c-4893-9cd7-9c752f11b200 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG cinder.volume.drivers.quobyte [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=91466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG cinder.volume.drivers.quobyte [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=91466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG oslo_concurrency.processutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=91466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:08:18 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:08:18 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:08:18 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG oslo_concurrency.processutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.580s {{(pid=91466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG cinder.manager [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Notifying Schedulers of capabilities ... {{(pid=91466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:08:18 devstack cinder-volume[91466]: INFO cinder.volume.manager [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Driver initialization completed successfully. Jun 11 05:08:18 devstack cinder-volume[91466]: INFO cinder.manager [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Initiating service 3 cleanup Jun 11 05:08:18 devstack cinder-volume[91466]: INFO cinder.manager [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Service 3 cleanup completed. Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG cinder.service [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Creating RPC server for service cinder-volume {{(pid=91466) start /opt/stack/cinder/cinder/service.py:231}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG cinder.service [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91466) start /opt/stack/cinder/cinder/service.py:237}} Jun 11 05:08:18 devstack cinder-volume[91466]: INFO cinder.volume.manager [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG cinder.volume.drivers.quobyte [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=91466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG cinder.volume.drivers.quobyte [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=91466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:08:18 devstack cinder-volume[91466]: DEBUG oslo_concurrency.processutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=91466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:08:18 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:08:18 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:08:19 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Jun 11 05:08:19 devstack cinder-volume[91466]: DEBUG oslo_concurrency.processutils [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.798s {{(pid=91466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:08:19 devstack cinder-volume[91466]: INFO cinder.volume.manager [None req-f9b55174-a312-4150-a303-2c9a06306e40 None None] Driver post RPC initialization completed successfully. Jun 11 05:08:23 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-88e41f0c-4363-4a16-86e6-673e95f60f2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:08:23 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-88e41f0c-4363-4a16-86e6-673e95f60f2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:08:23 devstack cinder-volume[91466]: DEBUG cinder.volume.drivers.quobyte [None req-88e41f0c-4363-4a16-86e6-673e95f60f2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=91466) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:08:23 devstack cinder-volume[91466]: DEBUG cinder.volume.drivers.quobyte [None req-88e41f0c-4363-4a16-86e6-673e95f60f2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=91466) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:08:23 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-88e41f0c-4363-4a16-86e6-673e95f60f2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91466) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:08:23 devstack cinder-volume[91466]: DEBUG oslo_concurrency.processutils [None req-88e41f0c-4363-4a16-86e6-673e95f60f2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=91466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:08:23 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:08:23 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:08:23 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Jun 11 05:08:23 devstack cinder-volume[91466]: DEBUG oslo_concurrency.processutils [None req-88e41f0c-4363-4a16-86e6-673e95f60f2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.565s {{(pid=91466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:08:23 devstack cinder-volume[91466]: DEBUG cinder.manager [None req-88e41f0c-4363-4a16-86e6-673e95f60f2d None None] Notifying Schedulers of capabilities ... {{(pid=91466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:08:26 devstack cinder-volume[91329]: DEBUG dbcounter [-] [91329] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=91329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:08:26 devstack cinder-volume[91329]: INFO oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Caught SIGTERM, stopping children Jun 11 05:08:26 devstack cinder-volume[91329]: DEBUG oslo_concurrency.lockutils [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Acquiring lock "singleton_lock" {{(pid=91329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 11 05:08:26 devstack cinder-volume[91329]: DEBUG oslo_concurrency.lockutils [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Acquired lock "singleton_lock" {{(pid=91329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 11 05:08:26 devstack cinder-volume[91329]: DEBUG oslo_concurrency.lockutils [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Releasing lock "singleton_lock" {{(pid=91329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 11 05:08:26 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Stop services. {{(pid=91329) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 11 05:08:26 devstack cinder-volume[91329]: DEBUG oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Killing children. {{(pid=91329) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 11 05:08:26 devstack cinder-volume[91329]: INFO oslo_service.backend._eventlet.service [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Waiting on 1 children to exit Jun 11 05:08:29 devstack cinder-volume[91466]: DEBUG dbcounter [-] [91466] Writing DB stats cinder:SELECT=4 {{(pid=91466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:08:29 devstack cinder-volume[91466]: DEBUG dbcounter [-] [91466] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=91466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:08:31 devstack cinder-volume[91466]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 11 05:08:32 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Acquiring lock "singleton_lock" {{(pid=91466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 11 05:08:32 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Acquired lock "singleton_lock" {{(pid=91466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 11 05:08:32 devstack cinder-volume[91466]: DEBUG oslo_concurrency.lockutils [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Releasing lock "singleton_lock" {{(pid=91466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 11 05:08:32 devstack cinder-volume[91466]: WARNING amqp [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 11 05:08:32 devstack cinder-volume[91466]: WARNING amqp [None req-fc0d4f2c-291a-44dd-bd77-1dc7e9706bf4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 11 05:08:35 devstack cinder-volume[92000]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 11 05:08:35 devstack cinder-volume[92000]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 11 05:08:35 devstack cinder-volume[92000]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 11 05:08:35 devstack cinder-volume[92000]: INFO dbcounter [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] Registered counter for database cinder Jun 11 05:08:35 devstack cinder-volume[92000]: DEBUG oslo_db.sqlalchemy.engines [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 11 05:08:35 devstack cinder-volume[92000]: DEBUG dbcounter [-] [92000] Writer thread running {{(pid=92000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 11 05:08:35 devstack cinder-volume[92000]: INFO cinder.rpc [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 11 05:08:35 devstack cinder-volume[92000]: INFO cinder.rpc [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 11 05:08:35 devstack cinder-volume[92000]: DEBUG oslo_db.sqlalchemy.engines [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 11 05:08:36 devstack cinder-volume[92000]: INFO cinder.volume.manager [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] Determined volume DB was empty at startup. Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG cinder.volume.manager [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92000) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 11 05:08:36 devstack cinder-volume[92000]: WARNING stevedore.named [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 11 05:08:36 devstack cinder-volume[92000]: WARNING castellan.key_manager [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 11 05:08:36 devstack cinder-volume[92000]: WARNING cinder.keymgr.conf_key_mgr [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 11 05:08:36 devstack cinder-volume[92000]: INFO cinder.volume.manager [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_db.sqlalchemy.engines [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 11 05:08:36 devstack cinder-volume[92000]: INFO oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] Starting 1 workers Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] Started child 92308 {{(pid=92000) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] Full set of CONF: {{(pid=92000) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] ******************************************************************************** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] Configuration options gathered from: {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] ================================================================================ {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] allow_availability_zone_fallback = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] allow_compression_on_image_upload = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] allowed_direct_url_schemes = [] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] api_rate_limit = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92308]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] auth_strategy = keystone {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_availability_zone = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_host = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_name = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_stats_polling_interval = 60 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backup_api_class = cinder.backup.api.API {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backup_name_template = backup-%s {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backup_use_same_host = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backup_use_temp_snapshot = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] chap_password = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] chap_username = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cinder_internal_tenant_project_id = bb414a05e85e4491801027bba83815ad {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cinder_internal_tenant_user_id = f6dba2ca779d419ea5eac90d1c62464f {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cluster = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] compression_format = gzip {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] compute_api_class = cinder.compute.nova.API {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] config_dir = [] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] config_source = [] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] control_exchange = openstack {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] debug = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] default_availability_zone = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] default_group_type = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] default_volume_type = QuobyteHD {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] disk_geometry = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] driver_client_cert = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] driver_client_cert_key = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] driver_data_namespace = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] driver_ssl_cert_path = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] driver_ssl_cert_verify = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] driver_use_ssl = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] enable_new_services = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] enable_unsupported_driver = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] enabled_backends = ['QuobyteHD'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] enforce_multipath_for_image_xfer = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] filter_function = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance_api_insecure = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance_api_ssl_compression = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance_ca_certificates_file = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance_catalog_info = image:glance:publicURL {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance_certfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance_keyfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance_num_retries = 3 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance_request_timeout = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] goodness_function = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] graceful_shutdown_timeout = 5 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] group_api_class = cinder.group.api.API {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] host = devstack {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] image_compress_on_upload = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] image_conversion_address_space_limit = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] image_conversion_cpu_limit = 60 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] image_conversion_disable = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] image_upload_use_cinder_backend = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] image_upload_use_internal_tenant = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] image_volume_cache_enabled = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] image_volume_cache_max_count = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] image_volume_cache_max_size_gb = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] init_host_max_objects_retrieval = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] instance_format = [instance: %(uuid)s] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] iscsi_target_flags = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] iscsi_write_cache = on {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] iser_helper = tgtadm {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] iser_ip_address = 192.168.122.208 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] iser_port = 3260 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] log_color = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] log_config_append = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] log_dir = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] log_file = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] log_options = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] log_rotate_interval = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] log_rotate_interval_type = days {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] log_rotation_type = none {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] max_age = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] max_logfile_count = 30 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] max_logfile_size_mb = 200 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92308) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] max_over_subscription_ratio = 20.0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] message_reap_interval = 86400 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] message_ttl = 2592000 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] migration_create_volume_timeout_secs = 300 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] monkey_patch = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] monkey_patch_modules = [] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] my_ip = 192.168.122.208 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] no_snapshot_gb_quota = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] num_iser_scan_tries = 3 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] num_shell_tries = 3 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] num_volume_device_scan_tries = 3 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] nvmeof_conn_info_version = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] nvmet_ns_id = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] nvmet_port_id = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] osapi_max_limit = 1000 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] osapi_volume_ext_list = [] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] osapi_volume_listen = 0.0.0.0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] osapi_volume_listen_port = 8776 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] osapi_volume_use_ssl = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] osapi_volume_workers = 2 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] per_volume_size_limit = -1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] periodic_fuzzy_delay = 60 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] periodic_interval = 60 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] project_id_regex = [0-9a-f\-]+ {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] public_endpoint = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] publish_errors = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] quota_backup_gigabytes = 1000 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] quota_backups = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] quota_gigabytes = 1000 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] quota_groups = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] quota_snapshots = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] quota_volumes = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] rate_limit_burst = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] rate_limit_except_level = CRITICAL {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] rate_limit_interval = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] reinit_driver_count = 3 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] replication_device = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] report_discard_supported = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] report_interval = 120 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] reservation_clean_interval = 86400 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] reservation_expire = 86400 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] reserved_image_namespaces = [] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] reserved_percentage = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] rpc_response_timeout = 120 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] run_external_periodic_tasks = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] scst_target_driver = iscsi {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] scst_target_iqn_name = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] service_down_time = 720 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] shell_completion = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] snapshot_name_template = snapshot-%s {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] split_loggers = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] state_path = /opt/stack/data/cinder {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] storage_availability_zone = nova {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] storage_protocol = iSCSI {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] syslog_log_facility = LOG_USER {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] target_helper = lioadm {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] target_ip_address = 192.168.122.208 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] target_port = 3260 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] target_protocol = iscsi {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] target_secondary_ip_addresses = [] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] trace_flags = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] transfer_api_class = cinder.transfer.api.API {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] transport_url = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] until_refresh = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] use_chap_auth = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] use_default_quota_class = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] use_journal = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] use_json = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] use_multipath_for_image_xfer = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] use_stderr = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] use_syslog = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] verify_glance_signatures = enabled {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] volume_api_class = cinder.volume.api.API {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] volume_backend_name = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] volume_clear = zero {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] volume_clear_ionice = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] volume_clear_size = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] volume_copy_bps_limit = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] volume_dd_blocksize = 1M {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] volume_name_template = volume-%s {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] volume_service_inithost_offload = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] volume_usage_audit_period = month {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] zoning_mode = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_concurrency.disable_process_locking = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.admin_password = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.admin_token = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.admin_user = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.auth_admin_prefix = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.auth_port = 35357 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.auth_protocol = https {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.auth_section = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.auth_type = password {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.auth_uri = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.auth_version = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.cache = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.certfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.delay_auth_decision = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.http_connect_timeout = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.identity_uri = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.include_service_catalog = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.insecure = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.interface = public {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.keyfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_password = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcache_username = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.region_name = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.service_token_roles_required = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.service_type = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.token_cache_time = 300 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.backend = dogpile.cache.null {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.backend_argument = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.backend_expiration_time = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.config_prefix = cache.oslo {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.debug_cache_backend = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.enable_retry_client = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.enable_socket_keepalive = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.enabled = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.enforce_fips_mode = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.expiration_time = 600 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.hashclient_retry_attempts = 2 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.memcache_dead_retry = 300 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.memcache_pool_maxsize = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.memcache_sasl_enabled = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.password = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.proxies = [] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.redis_db = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.redis_sentinel_service_name = mymaster {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.redis_server = localhost:6379 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.retry_attempts = 2 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.retry_delay = 0.0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.socket_keepalive_count = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.socket_keepalive_idle = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.socket_keepalive_interval = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.socket_timeout = 1.0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.tls_allowed_ciphers = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.tls_cafile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.tls_certfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.tls_enabled = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.tls_keyfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cache.username = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.asyncio_connection = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.asyncio_slave_connection = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.backend = sqlalchemy {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.connection = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.connection_debug = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.connection_parameters = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.connection_recycle_time = 3600 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.connection_trace = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.db_inc_retry_interval = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.db_max_retries = 20 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.db_max_retry_interval = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.db_retry_interval = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.max_overflow = 50 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.max_pool_size = 5 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.max_retries = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.mysql_wsrep_sync_wait = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.pool_timeout = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.retry_interval = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.slave_connection = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.sqlite_synchronous = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.synchronous_reader = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] database.use_db_reconnect = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler.connection_string = messaging:// {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler.enabled = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler.es_doc_type = notification {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler.es_scroll_size = 10000 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler.es_scroll_time = 2m {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler.filter_error_trace = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler.hmac_keys = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler.sentinel_service_name = mymaster {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler.socket_timeout = 0.1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler.trace_requests = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler.trace_sqlalchemy = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler_jaeger.process_tags = {} {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler_jaeger.service_name_prefix = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] profiler_otlp.service_name_prefix = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92308) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_policy.enforce_new_defaults = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: WARNING oslo_config.cfg [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 11 05:08:36 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.quobyte [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 11 05:08:36 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.quobyte [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_policy.enforce_scope = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_policy.policy_default_rule = default {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_policy.policy_file = policy.yaml {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Running cmd (subprocess): mount.quobyte {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_policy.remote_timeout = 60.0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] coordination.backend_url = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] privsep_osbrick.group = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] privsep_osbrick.helper_command = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] privsep_osbrick.user = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cinder_sys_admin.group = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cinder_sys_admin.helper_command = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] cinder_sys_admin.user = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] service_user.auth_section = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] service_user.auth_type = password {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] service_user.cafile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] service_user.certfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] service_user.collect_timing = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] service_user.insecure = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] service_user.keyfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] service_user.send_service_user_token = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] service_user.split_loggers = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] service_user.timeout = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance.auth_section = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance.auth_type = password {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance.certfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance.collect_timing = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance.insecure = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance.keyfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance.region_name = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance.split_loggers = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] glance.timeout = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.backend_availability_zone = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.chap_password = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.chap_username = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.disk_geometry = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.driver_client_cert = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.driver_client_cert_key = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.driver_data_namespace = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.driver_use_ssl = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.enable_unsupported_driver = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.extra_capabilities = {} {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.filter_function = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.goodness_function = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.iscsi_target_flags = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.iscsi_write_cache = on {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.iser_helper = tgtadm {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.iser_port = 3260 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.nas_host = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.nas_login = admin {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.nas_mount_options = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.nas_password = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.nas_private_key = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.nas_share_path = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.nas_ssh_port = 22 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.num_shell_tries = 3 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.nvmet_port_id = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.quobyte_client_cfg = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.quobyte_volume_url = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.replication_device = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.report_discard_supported = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.reserved_percentage = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.scst_target_driver = iscsi {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.scst_target_iqn_name = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.storage_protocol = iSCSI {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.target_helper = tgtadm {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.target_port = 3260 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.target_protocol = iscsi {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.trace_flags = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.unique_fqdn_network = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.use_chap_auth = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.volume_backend_name = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.volume_clear = zero {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.volume_clear_ionice = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.volume_clear_size = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_reports.file_event_handler = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_reports.log_dir = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.backend_availability_zone = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.backend_host = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.chap_password = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.chap_username = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.chiscsi_conf = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.disk_geometry = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.driver_client_cert = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.driver_client_cert_key = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.driver_data_namespace = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.driver_use_ssl = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.extra_capabilities = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.filter_function = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.goodness_function = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.iscsi_target_flags = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.iscsi_write_cache = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.iser_helper = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.iser_ip_address = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.iser_port = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.iser_target_prefix = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.nas_host = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.nas_login = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.nas_mount_options = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.nas_password = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.nas_private_key = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.nas_share_path = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.nas_ssh_port = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.num_shell_tries = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.nvmet_ns_id = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.nvmet_port_id = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.replication_device = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.report_discard_supported = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.reserved_percentage = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.scst_target_driver = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.storage_protocol = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.target_helper = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.target_ip_address = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.target_port = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.target_prefix = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.target_protocol = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.trace_flags = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.unique_fqdn_network = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.use_chap_auth = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.volume_clear = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.volume_clear_ionice = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.volume_clear_size = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] QuobyteHD.volumes_dir = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack quobyte-client[92309]: Reading configuration file: /etc/quobyte/client.cfg Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack quobyte-client[92309]: Invalid parameters found, error: missing mount point. Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack quobyte-client[92309]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack quobyte-client[92309]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.ssl = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.ssl_version = {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_notifications.driver = [] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_notifications.retry = -1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] oslo_messaging_notifications.transport_url = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] key_manager.fixed_key = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.barbican_api_version = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.barbican_endpoint = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.barbican_endpoint_type = public {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.barbican_region_name = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.cafile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.certfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.collect_timing = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.insecure = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.keyfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.number_of_retries = 60 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.retry_delay = 1 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.send_service_user_token = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.split_loggers = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.timeout = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.verify_ssl = True {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican.verify_ssl_path = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican_service_user.auth_section = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican_service_user.auth_type = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican_service_user.cafile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican_service_user.certfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican_service_user.collect_timing = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican_service_user.insecure = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican_service_user.keyfile = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican_service_user.split_loggers = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] barbican_service_user.timeout = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] vault.approle_role_id = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] vault.approle_secret_id = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] vault.kv_mountpoint = secret {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] vault.kv_path = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] vault.kv_version = 2 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] vault.namespace = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] vault.root_token_id = **** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] vault.ssl_ca_crt_file = None {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] vault.timeout = 60.0 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] vault.use_ssl = False {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 11 05:08:36 devstack cinder-volume[92000]: DEBUG oslo_service.backend._eventlet.service [None req-bb3e054d-1678-4e4d-936d-b49e7be8f60b None None] ******************************************************************************** {{(pid=92000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 11 05:08:36 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:08:36 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:08:36 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.541s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:08:36 devstack cinder-volume[92308]: INFO cinder.volume.driver [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Driver hasn't implemented _init_vendor_properties() Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG cinder.volume.driver [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92308) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG oslo_db.sqlalchemy.engines [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92308) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writer thread running {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG cinder.db.sqlalchemy.api [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Building query based on filter {{(pid=92308) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92308) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:08:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:08:36 devstack cinder-volume[92308]: INFO cinder.keymgr.migration [None req-06602707-1845-470b-9a9c-b99f00e09078 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 11 05:08:36 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:08:36 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:08:37 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Jun 11 05:08:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.595s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:08:37 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:08:37 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Driver initialization completed successfully. Jun 11 05:08:37 devstack cinder-volume[92308]: INFO cinder.manager [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Initiating service 3 cleanup Jun 11 05:08:37 devstack cinder-volume[92308]: INFO cinder.manager [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Service 3 cleanup completed. Jun 11 05:08:37 devstack cinder-volume[92308]: DEBUG cinder.service [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Creating RPC server for service cinder-volume {{(pid=92308) start /opt/stack/cinder/cinder/service.py:231}} Jun 11 05:08:37 devstack cinder-volume[92308]: DEBUG cinder.service [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92308) start /opt/stack/cinder/cinder/service.py:237}} Jun 11 05:08:37 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 11 05:08:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:08:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:08:37 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:08:37 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:08:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:08:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:08:37 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:08:37 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:08:38 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Jun 11 05:08:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.554s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:08:38 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2563b7ca-da0a-4fe2-b880-a3e00a6ce7c0 None None] Driver post RPC initialization completed successfully. Jun 11 05:08:46 devstack cinder-volume[92000]: DEBUG dbcounter [-] [92000] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=92000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:08:47 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:08:48 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=3 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:09:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:09:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 6 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:09:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Flow 'volume_create_manager' (402cb71b-ff18-4f66-94c4-6140c78fdd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a85b49-4d2e-46f6-9f78-e9819a9af4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a85b49-4d2e-46f6-9f78-e9819a9af4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2058717671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c6047f0-3791-4af3-a9fa-e74b6abb8b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883f5a3228fd4ac19a9e4b123a0e51b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:09:35Z,use_quota=True,user_id='a7a836d5282046dc82d454b400c70802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8b3162-d38d-482a-ac73-5406bdf1bcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8b3162-d38d-482a-ac73-5406bdf1bcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7bbeb5-02ac-4f1d-a080-9f21b9f8b35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7bbeb5-02ac-4f1d-a080-9f21b9f8b35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c6047f0-3791-4af3-a9fa-e74b6abb8b9b', 'volume_name': 'volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3468b3fa-80ea-4c07-ab11-3885c14aa742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3468b3fa-80ea-4c07-ab11-3885c14aa742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e34098e-c424-4876-897e-583dd4dbf8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:09:35 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Volume 1c6047f0-3791-4af3-a9fa-e74b6abb8b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b', 'volume_size': 1} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2058717671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c6047f0-3791-4af3-a9fa-e74b6abb8b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883f5a3228fd4ac19a9e4b123a0e51b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:09:35Z,use_quota=True,user_id='a7a836d5282046dc82d454b400c70802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Creating volume 1c6047f0-3791-4af3-a9fa-e74b6abb8b9b {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:09:35 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:09:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:09:35 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b 1073741824 Jun 11 05:09:35 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:09:36 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Jun 11 05:09:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b 1073741824" returned: 0 in 1.464s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:09:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:09:36 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b Jun 11 05:09:36 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:09:37 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Jun 11 05:09:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b" returned: 0 in 0.797s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:09:37 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] <== create_volume: return (2356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:09:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.358s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:09:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e34098e-c424-4876-897e-583dd4dbf8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:09:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec3b80b-72d8-4980-8202-81ebf94a7da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:09:37 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Volume volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b (1c6047f0-3791-4af3-a9fa-e74b6abb8b9b): created successfully Jun 11 05:09:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec3b80b-72d8-4980-8202-81ebf94a7da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:09:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Flow 'volume_create_manager' (402cb71b-ff18-4f66-94c4-6140c78fdd2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:09:37 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-17d38806-5c3c-4799-bdbb-beaec65af953 tempest-TaggedAttachmentsTest-199253077 None] Created volume successfully. Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Flow 'volume_create_manager' (79b8e0e9-21e4-48f0-ad90-e477f500238e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18dbb7c8-176d-499a-93a7-0b0b405a5b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18dbb7c8-176d-499a-93a7-0b0b405a5b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-501323002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8e819b-3586-4d13-b2b1-a8a6e7c557c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadf9edf0efe47a796f9b6159539aeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:09:46Z,use_quota=True,user_id='47ef464942084075876d525981429135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3813c85-7ffc-4bf4-b10d-0dfe1e8bd4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3813c85-7ffc-4bf4-b10d-0dfe1e8bd4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee5c00d-1c94-4699-86b7-e0bbd6188da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee5c00d-1c94-4699-86b7-e0bbd6188da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e8e819b-3586-4d13-b2b1-a8a6e7c557c5', 'volume_name': 'volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d9dbb7-2fa7-42a2-8d33-c4bdd4e8558f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d9dbb7-2fa7-42a2-8d33-c4bdd4e8558f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7708b53-3063-4552-8a43-2e1fcba0189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:09:46 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Volume 0e8e819b-3586-4d13-b2b1-a8a6e7c557c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5', 'volume_size': 1} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-501323002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8e819b-3586-4d13-b2b1-a8a6e7c557c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadf9edf0efe47a796f9b6159539aeee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:09:46Z,use_quota=True,user_id='47ef464942084075876d525981429135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Creating volume 0e8e819b-3586-4d13-b2b1-a8a6e7c557c5 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:09:46 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:09:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:09:46 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5 1073741824 Jun 11 05:09:46 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:09:48 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Jun 11 05:09:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5 1073741824" returned: 0 in 1.932s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:09:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:09:48 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5 Jun 11 05:09:48 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:09:49 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Jun 11 05:09:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5" returned: 0 in 1.323s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:09:49 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] <== create_volume: return (3366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:09:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.374s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:09:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7708b53-3063-4552-8a43-2e1fcba0189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:09:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36a1d93-09e9-4b55-98db-6c01cb74e757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:09:49 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Volume volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5 (0e8e819b-3586-4d13-b2b1-a8a6e7c557c5): created successfully Jun 11 05:09:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36a1d93-09e9-4b55-98db-6c01cb74e757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:09:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Flow 'volume_create_manager' (79b8e0e9-21e4-48f0-ad90-e477f500238e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:09:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b59a8407-a04e-4a97-9d7f-8bbf14a316cf tempest-DeleteServersTestJSON-489345483 None] Created volume successfully. Jun 11 05:09:58 devstack cinder-volume[92308]: WARNING py.warnings [req-24e82e1a-f2b6-40eb-91dc-8926ef847dd8 req-07ab942e-182c-4386-abdd-3c9247b67389 tempest-DeleteServersTestJSON-489345483 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2505: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jun 11 05:09:58 devstack cinder-volume[92308]: .first() Jun 11 05:09:58 devstack cinder-volume[92308]: Jun 11 05:09:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-24e82e1a-f2b6-40eb-91dc-8926ef847dd8 req-07ab942e-182c-4386-abdd-3c9247b67389 tempest-DeleteServersTestJSON-489345483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:09:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-24e82e1a-f2b6-40eb-91dc-8926ef847dd8 req-07ab942e-182c-4386-abdd-3c9247b67389 tempest-DeleteServersTestJSON-489345483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:09:58 devstack cinder-volume[92308]: INFO oslo.privsep.daemon [req-24e82e1a-f2b6-40eb-91dc-8926ef847dd8 req-07ab942e-182c-4386-abdd-3c9247b67389 tempest-DeleteServersTestJSON-489345483 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5a09kgph/privsep.sock'] Jun 11 05:09:58 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5a09kgph/privsep.sock Jun 11 05:09:58 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:09:59 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:10:00 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Jun 11 05:10:00 devstack cinder-volume[92308]: INFO oslo.privsep.daemon [req-24e82e1a-f2b6-40eb-91dc-8926ef847dd8 req-07ab942e-182c-4386-abdd-3c9247b67389 tempest-DeleteServersTestJSON-489345483 None] Spawned new privsep daemon via rootwrap Jun 11 05:10:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [req-24e82e1a-f2b6-40eb-91dc-8926ef847dd8 req-07ab942e-182c-4386-abdd-3c9247b67389 tempest-DeleteServersTestJSON-489345483 None] Accepted privsep connection to /tmp/tmp5a09kgph/privsep.sock {{(pid=92308) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 11 05:10:00 devstack cinder-volume[92308]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 11 05:10:00 devstack cinder-volume[92308]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 11 05:10:00 devstack cinder-volume[92308]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 11 05:10:00 devstack cinder-volume[92308]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 93142 Jun 11 05:10:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba1c464-6620-41e4-bf60-8e3642c58c47]: (2,) {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:10:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aabd762-d9ba-4a1c-b50a-4f96bd1059ca]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:10:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-24e82e1a-f2b6-40eb-91dc-8926ef847dd8 req-07ab942e-182c-4386-abdd-3c9247b67389 tempest-DeleteServersTestJSON-489345483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:10:00 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5 Jun 11 05:10:00 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:10:00 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Jun 11 05:10:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-24e82e1a-f2b6-40eb-91dc-8926ef847dd8 req-07ab942e-182c-4386-abdd-3c9247b67389 tempest-DeleteServersTestJSON-489345483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5" returned: 0 in 0.736s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:10:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-24e82e1a-f2b6-40eb-91dc-8926ef847dd8 req-07ab942e-182c-4386-abdd-3c9247b67389 tempest-DeleteServersTestJSON-489345483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.667s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:10:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-24e82e1a-f2b6-40eb-91dc-8926ef847dd8 req-07ab942e-182c-4386-abdd-3c9247b67389 tempest-DeleteServersTestJSON-489345483 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed91860a-66d2-461f-8ff8-639e636532cb', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:10:01 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-24e82e1a-f2b6-40eb-91dc-8926ef847dd8 req-07ab942e-182c-4386-abdd-3c9247b67389 tempest-DeleteServersTestJSON-489345483 None] attachment_update completed successfully. Jun 11 05:10:11 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-18e18575-ca87-4c61-98ba-423968685656 req-07c90d0f-a0cd-4fd7-af88-4ddedfb08c0b tempest-DeleteServersTestJSON-489345483 None] Terminate volume connection completed successfully. Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-18e18575-ca87-4c61-98ba-423968685656 req-07c90d0f-a0cd-4fd7-af88-4ddedfb08c0b tempest-DeleteServersTestJSON-489345483 None] Deleting attachment ed91860a-66d2-461f-8ff8-639e636532cb. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Flow 'volume_create_manager' (fbd82949-16c2-4ab2-b415-0d4ba93506b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93f2af8-dfe4-4700-86ac-5f4869bf3983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93f2af8-dfe4-4700-86ac-5f4869bf3983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-808294643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708a40c5-a22d-4711-914d-14dd3ae84e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a8805bbce14774ae751a0df59469ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:10:12Z,use_quota=True,user_id='2ce808ed1c0943a293406b0957b8397a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18afc02-974a-4099-8f8b-4a37a89987f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18afc02-974a-4099-8f8b-4a37a89987f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350b3f38-902c-4a57-9093-47cf02756d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350b3f38-902c-4a57-9093-47cf02756d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '708a40c5-a22d-4711-914d-14dd3ae84e3f', 'volume_name': 'volume-708a40c5-a22d-4711-914d-14dd3ae84e3f', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cf1172-59ad-45b8-97e9-8502d77ca6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cf1172-59ad-45b8-97e9-8502d77ca6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c741906-2e90-4f4d-865b-5b940000033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:10:11 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Volume 708a40c5-a22d-4711-914d-14dd3ae84e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-708a40c5-a22d-4711-914d-14dd3ae84e3f', 'volume_size': 1} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-808294643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708a40c5-a22d-4711-914d-14dd3ae84e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a8805bbce14774ae751a0df59469ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:10:12Z,use_quota=True,user_id='2ce808ed1c0943a293406b0957b8397a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Creating volume 708a40c5-a22d-4711-914d-14dd3ae84e3f {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:10:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:10:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:10:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:10:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:10:12 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:10:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:10:12 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f 1073741824 Jun 11 05:10:12 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:10:12 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Jun 11 05:10:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f 1073741824" returned: 0 in 0.985s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:10:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:10:13 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f Jun 11 05:10:13 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:10:13 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Jun 11 05:10:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f" returned: 0 in 0.696s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:10:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:10:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:10:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c741906-2e90-4f4d-865b-5b940000033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-708a40c5-a22d-4711-914d-14dd3ae84e3f', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:10:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e031bb91-6171-4714-a618-4bdbc6505ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:10:13 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Volume volume-708a40c5-a22d-4711-914d-14dd3ae84e3f (708a40c5-a22d-4711-914d-14dd3ae84e3f): created successfully Jun 11 05:10:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e031bb91-6171-4714-a618-4bdbc6505ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:10:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Flow 'volume_create_manager' (fbd82949-16c2-4ab2-b415-0d4ba93506b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:10:13 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-51272a3c-f9c0-4cd5-beae-ae774661bd7e tempest-AttachVolumeShelveTestJSON-34116855 None] Created volume successfully. Jun 11 05:10:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Acquiring lock "cinder-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:10:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Lock "cinder-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:10:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Acquiring lock "cinder-quobyte-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:10:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Lock "cinder-quobyte-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5" acquired by "delete_volume" :: waited 0.040s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:10:15 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e6300d-58df-41c7-92b2-cc488a811f40]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:10:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:10:15 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5 Jun 11 05:10:15 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:10:16 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jun 11 05:10:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5" returned: 0 in 0.825s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:10:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:10:16 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5 Jun 11 05:10:16 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:10:17 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Jun 11 05:10:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5" returned: 0 in 0.916s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:10:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Lock "cinder-quobyte-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5" released by "delete_volume" :: held 1.811s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:10:17 devstack cinder-volume[92308]: WARNING cinder.quota [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:10:17 devstack cinder-volume[92308]: WARNING cinder.quota [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:10:17 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Created reservations ['c5bd0cad-7fa0-4196-a28c-2c49a3a73d5b', '2bf520e5-65e9-4283-bee4-672c5c2fc361', 'ac059101-6524-436b-b36b-36ffd0ba34eb', '0c483645-1e24-4b3c-a02b-9e0bf5b6bdc3'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:10:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:10:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:10:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:10:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:10:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:10:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:10:17 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:10:17 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:10:18 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Jun 11 05:10:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.963s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:10:18 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:10:18 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Deleted volume successfully. Jun 11 05:10:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3057b601-a4db-47cb-ba4a-be437cb62d5b tempest-DeleteServersTestJSON-489345483 None] Lock "cinder-0e8e819b-3586-4d13-b2b1-a8a6e7c557c5-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:10:27 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1,cinder:SELECT=16 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:10:28 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=12,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=3 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:10:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:10:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:10:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:10:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:10:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:10:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:10:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:10:30 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:10:30 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:10:31 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Jun 11 05:10:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.824s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:10:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:10:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:10:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 8 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:10:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:10:48 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=1 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:10:48 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=1 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:10:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-455dc26c-d74d-48d8-9327-20e02761402e req-0e63842e-6ca1-4a52-9475-c6e71a3b0fcf tempest-AttachVolumeShelveTestJSON-34116855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:10:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-455dc26c-d74d-48d8-9327-20e02761402e req-0e63842e-6ca1-4a52-9475-c6e71a3b0fcf tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:10:48 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9212a870-3683-4b6e-941a-5626999a916b]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:10:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-455dc26c-d74d-48d8-9327-20e02761402e req-0e63842e-6ca1-4a52-9475-c6e71a3b0fcf tempest-AttachVolumeShelveTestJSON-34116855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:10:48 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f Jun 11 05:10:48 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:10:49 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Jun 11 05:10:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-455dc26c-d74d-48d8-9327-20e02761402e req-0e63842e-6ca1-4a52-9475-c6e71a3b0fcf tempest-AttachVolumeShelveTestJSON-34116855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f" returned: 0 in 0.700s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:10:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-455dc26c-d74d-48d8-9327-20e02761402e req-0e63842e-6ca1-4a52-9475-c6e71a3b0fcf tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.720s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:10:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-455dc26c-d74d-48d8-9327-20e02761402e req-0e63842e-6ca1-4a52-9475-c6e71a3b0fcf tempest-AttachVolumeShelveTestJSON-34116855 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-708a40c5-a22d-4711-914d-14dd3ae84e3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cda6c5d0-9de5-4274-a4b3-8421403b6f32', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:10:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-455dc26c-d74d-48d8-9327-20e02761402e req-0e63842e-6ca1-4a52-9475-c6e71a3b0fcf tempest-AttachVolumeShelveTestJSON-34116855 None] attachment_update completed successfully. Jun 11 05:10:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-b3c6a2d6-cc5d-4a5b-a399-5a5c73d792cf req-31f452ca-b2a4-453d-8425-115e6fda71e7 tempest-TaggedAttachmentsTest-199253077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:10:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-b3c6a2d6-cc5d-4a5b-a399-5a5c73d792cf req-31f452ca-b2a4-453d-8425-115e6fda71e7 tempest-TaggedAttachmentsTest-199253077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:10:51 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b368cced-0091-498a-a6f3-a5a57a22fe8f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:10:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-b3c6a2d6-cc5d-4a5b-a399-5a5c73d792cf req-31f452ca-b2a4-453d-8425-115e6fda71e7 tempest-TaggedAttachmentsTest-199253077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:10:52 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b Jun 11 05:10:52 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:10:52 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Jun 11 05:10:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-b3c6a2d6-cc5d-4a5b-a399-5a5c73d792cf req-31f452ca-b2a4-453d-8425-115e6fda71e7 tempest-TaggedAttachmentsTest-199253077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b" returned: 0 in 0.875s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:10:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-b3c6a2d6-cc5d-4a5b-a399-5a5c73d792cf req-31f452ca-b2a4-453d-8425-115e6fda71e7 tempest-TaggedAttachmentsTest-199253077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.904s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:10:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b3c6a2d6-cc5d-4a5b-a399-5a5c73d792cf req-31f452ca-b2a4-453d-8425-115e6fda71e7 tempest-TaggedAttachmentsTest-199253077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99699eca-1263-4409-97ab-e5fc04b9ec73', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:10:52 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-b3c6a2d6-cc5d-4a5b-a399-5a5c73d792cf req-31f452ca-b2a4-453d-8425-115e6fda71e7 tempest-TaggedAttachmentsTest-199253077 None] attachment_update completed successfully. Jun 11 05:11:02 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:11:02 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Flow 'volume_create_manager' (d19f764b-b300-4cbf-b04b-5c133de0b130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7285a2e8-6b50-4e5b-aa11-87c177363ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7285a2e8-6b50-4e5b-aa11-87c177363ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1541949515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbca9ff-a168-4278-a4ec-7e8fb2073437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3faa1493144548529c90206e710a010a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:11:04Z,use_quota=True,user_id='e7688e386f7f4b1c8f9fa72c9e2650ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35ef64b-b06d-435b-968b-de11b18328a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35ef64b-b06d-435b-968b-de11b18328a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf50889-832a-4b48-99a4-8ac8ee98b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf50889-832a-4b48-99a4-8ac8ee98b597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dbca9ff-a168-4278-a4ec-7e8fb2073437', 'volume_name': 'volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15e0858-5423-4c58-9544-e920fb877e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15e0858-5423-4c58-9544-e920fb877e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d00b6d3-c971-4571-a30f-51597d98153a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:04 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Volume 2dbca9ff-a168-4278-a4ec-7e8fb2073437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437', 'volume_size': 1} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1541949515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbca9ff-a168-4278-a4ec-7e8fb2073437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3faa1493144548529c90206e710a010a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:11:04Z,use_quota=True,user_id='e7688e386f7f4b1c8f9fa72c9e2650ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Creating volume 2dbca9ff-a168-4278-a4ec-7e8fb2073437 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:11:04 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:11:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:04 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437 1073741824 Jun 11 05:11:04 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:05 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-5993ed93-f000-40cc-9603-7379f46e468e req-27460597-9f7e-456b-9811-dbccdfc321c8 tempest-TaggedAttachmentsTest-199253077 None] Terminate volume connection completed successfully. Jun 11 05:11:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-5993ed93-f000-40cc-9603-7379f46e468e req-27460597-9f7e-456b-9811-dbccdfc321c8 tempest-TaggedAttachmentsTest-199253077 None] Deleting attachment 99699eca-1263-4409-97ab-e5fc04b9ec73. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:11:05 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437 1073741824" returned: 0 in 1.499s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:06 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437 Jun 11 05:11:06 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:06 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437" returned: 0 in 0.815s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] <== create_volume: return (2412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:11:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.417s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d00b6d3-c971-4571-a30f-51597d98153a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea59c4ce-e485-45e4-b9f4-176925ea4e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:06 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Volume volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437 (2dbca9ff-a168-4278-a4ec-7e8fb2073437): created successfully Jun 11 05:11:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea59c4ce-e485-45e4-b9f4-176925ea4e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Flow 'volume_create_manager' (d19f764b-b300-4cbf-b04b-5c133de0b130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:11:06 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-435d7bf6-34f7-4ed5-a1ee-b00941aab926 tempest-VolumesAdminNegativeTest-1958016102 None] Created volume successfully. Jun 11 05:11:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Acquiring lock "cinder-2dbca9ff-a168-4278-a4ec-7e8fb2073437-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:11:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Lock "cinder-2dbca9ff-a168-4278-a4ec-7e8fb2073437-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:11:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Acquiring lock "cinder-quobyte-2dbca9ff-a168-4278-a4ec-7e8fb2073437" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:11:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Lock "cinder-quobyte-2dbca9ff-a168-4278-a4ec-7e8fb2073437" acquired by "delete_volume" :: waited 0.033s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:11:08 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6902cfb5-ce29-4d17-ae99-e1a02f82d051]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:11:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:08 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437 Jun 11 05:11:08 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:09 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437" returned: 0 in 1.037s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:09 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437 Jun 11 05:11:09 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:10 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2dbca9ff-a168-4278-a4ec-7e8fb2073437" returned: 0 in 1.232s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Lock "cinder-quobyte-2dbca9ff-a168-4278-a4ec-7e8fb2073437" released by "delete_volume" :: held 2.342s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:11:10 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Created reservations ['cefd7554-6b8f-4264-8815-7529f3fb4a7e', '25652f3e-d904-44a1-a1df-cfa11e3ab8a9', 'e94fa0e9-c59a-478c-abeb-6d6cedebf3df', '54ecd026-5e35-44d3-87a3-77e7b8a0e420'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:11:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:11:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:11:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.070s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:11 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:11:11 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:12 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.740s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:12 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:11:12 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Deleted volume successfully. Jun 11 05:11:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9234539f-6f96-4447-bfd0-c1fbf4f6522f tempest-VolumesAdminNegativeTest-1958016102 None] Lock "cinder-2dbca9ff-a168-4278-a4ec-7e8fb2073437-delete_volume" released by "delete_volume" :: held 4.655s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:11:20 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=3 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:11:22 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Flow 'volume_create_manager' (94c6620c-96b6-4022-bad4-81eb9f87120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f171f97-f925-4f41-9f49-e2d410b82c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f171f97-f925-4f41-9f49-e2d410b82c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1334645842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb50911-8ae3-4c68-8a3c-987b7bd6fb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005860360f8a4e23a9ba71dfa5aa285d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:11:24Z,use_quota=True,user_id='c6f1d5a3bef24faeaccab01229ba8de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54463ae1-f54f-4047-8335-0ea76c1164d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54463ae1-f54f-4047-8335-0ea76c1164d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125fb041-92fe-4f6a-b11d-7c75e511948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125fb041-92fe-4f6a-b11d-7c75e511948a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb50911-8ae3-4c68-8a3c-987b7bd6fb04', 'volume_name': 'volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dadd6b21-3218-43c0-a188-162f4df18493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dadd6b21-3218-43c0-a188-162f4df18493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac27632-da3e-49c4-98ea-dea34dfa1c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:24 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Volume 1fb50911-8ae3-4c68-8a3c-987b7bd6fb04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04', 'volume_size': 1} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1334645842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb50911-8ae3-4c68-8a3c-987b7bd6fb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005860360f8a4e23a9ba71dfa5aa285d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:11:24Z,use_quota=True,user_id='c6f1d5a3bef24faeaccab01229ba8de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Creating volume 1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:11:24 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:11:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:24 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 1073741824 Jun 11 05:11:24 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:25 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 1073741824" returned: 0 in 1.298s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:25 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 Jun 11 05:11:25 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:26 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04" returned: 0 in 0.802s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:11:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac27632-da3e-49c4-98ea-dea34dfa1c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e32763a0-85b4-4d2b-b86b-49a60eb9a885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:26 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Volume volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 (1fb50911-8ae3-4c68-8a3c-987b7bd6fb04): created successfully Jun 11 05:11:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e32763a0-85b4-4d2b-b86b-49a60eb9a885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Flow 'volume_create_manager' (94c6620c-96b6-4022-bad4-81eb9f87120f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:11:26 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-ae5602f8-6238-4b06-8498-f40fc59fa894 tempest-ServerActionsTestOtherA-987815009 None] Created volume successfully. Jun 11 05:11:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Acquiring lock "cinder-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:11:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Lock "cinder-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:11:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Acquiring lock "cinder-quobyte-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:11:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Lock "cinder-quobyte-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b" acquired by "delete_volume" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:11:28 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7aafde-5a6d-4428-9fa5-ed5d5621d42b]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:11:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:28 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b Jun 11 05:11:28 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:29 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b" returned: 0 in 0.765s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:29 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b Jun 11 05:11:29 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:30 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b" returned: 0 in 0.614s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Lock "cinder-quobyte-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b" released by "delete_volume" :: held 1.458s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:11:30 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:11:30 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Created reservations ['587373a9-9aca-443b-b7af-79ac6fb9550c', '88d5f0c5-5c3c-4a06-90b8-3d253075c5eb', 'eb7e2ed8-9fd1-46c9-8f85-51ff3055ed36', 'a2bc5bc0-94ba-48ad-b2ec-3b8336e8e26e'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:30 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:11:30 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:31 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.796s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:11:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:11:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 8 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:11:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:11:31 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.673s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:11:31 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Deleted volume successfully. Jun 11 05:11:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-74eefaae-6079-4405-a2c3-90f7960a4435 tempest-TaggedAttachmentsTest-199253077 None] Lock "cinder-1c6047f0-3791-4af3-a9fa-e74b6abb8b9b-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:11:36 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-f987054d-817a-4117-a1ae-2890eab73c0f req-e2522327-0412-42b8-a22b-ce9b6b6dbfb1 tempest-AttachVolumeShelveTestJSON-34116855 None] Terminate volume connection completed successfully. Jun 11 05:11:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-f987054d-817a-4117-a1ae-2890eab73c0f req-e2522327-0412-42b8-a22b-ce9b6b6dbfb1 tempest-AttachVolumeShelveTestJSON-34116855 None] Deleting attachment cda6c5d0-9de5-4274-a4b3-8421403b6f32. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Flow 'volume_create_manager' (4ebdbd2f-abe3-4e67-8c8e-883d32604360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a897216-8392-42f0-a52a-9839cf1fafa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a897216-8392-42f0-a52a-9839cf1fafa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2101620535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bd8eff-d3e8-404b-ba7e-eca471f512f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b82ff1ce33354e4a806e4344d0c7cb14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:11:41Z,use_quota=True,user_id='9e09ba30ded8414cad72733c31f76e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7718d0f-fe4f-46ee-9e6e-3e50e6e5b124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7718d0f-fe4f-46ee-9e6e-3e50e6e5b124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d93964-1305-43ea-a5d0-8ead27cb252e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d93964-1305-43ea-a5d0-8ead27cb252e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3bd8eff-d3e8-404b-ba7e-eca471f512f9', 'volume_name': 'volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbd83e2-ab2b-4230-9080-715266557912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbd83e2-ab2b-4230-9080-715266557912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48716cb9-5afd-47ce-b1de-d6ca915ed37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:41 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Volume a3bd8eff-d3e8-404b-ba7e-eca471f512f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9', 'volume_size': 1} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2101620535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bd8eff-d3e8-404b-ba7e-eca471f512f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b82ff1ce33354e4a806e4344d0c7cb14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:11:41Z,use_quota=True,user_id='9e09ba30ded8414cad72733c31f76e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Creating volume a3bd8eff-d3e8-404b-ba7e-eca471f512f9 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:11:41 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:11:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:41 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9 1073741824 Jun 11 05:11:41 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:42 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9 1073741824" returned: 0 in 1.231s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:42 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9 Jun 11 05:11:42 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:44 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9" returned: 0 in 1.226s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] <== create_volume: return (2527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:11:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.531s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48716cb9-5afd-47ce-b1de-d6ca915ed37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcff643-1354-4a3b-98a0-507bde91ca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:44 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Volume volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9 (a3bd8eff-d3e8-404b-ba7e-eca471f512f9): created successfully Jun 11 05:11:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcff643-1354-4a3b-98a0-507bde91ca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Flow 'volume_create_manager' (4ebdbd2f-abe3-4e67-8c8e-883d32604360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:11:44 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-b22c3578-dd00-4398-8ec7-7e57cac08d5b req-11df70ac-e6ac-4dc5-93f5-759feacb18f0 tempest-VolumesGetTestJSON-1419690703 None] Created volume successfully. Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Flow 'volume_create_manager' (de04b2d6-80a5-4c34-a165-399e6be6195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af903419-a572-4d6e-a0d2-2dcb6d23ee99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Acquiring lock "cinder-a3bd8eff-d3e8-404b-ba7e-eca471f512f9-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af903419-a572-4d6e-a0d2-2dcb6d23ee99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1620430526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7666a2ed-77f1-40d6-b2b2-b442090fa9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31692cb470d742bc85e931ee2fa8ff4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:11:46Z,use_quota=True,user_id='48db0d4f057f4dc9b0f49b661f3f695d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ed8b6f-1b7f-4401-9676-bc08d4a3888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ed8b6f-1b7f-4401-9676-bc08d4a3888f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbb3173-d3e4-46e5-9132-85158524756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbb3173-d3e4-46e5-9132-85158524756c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7666a2ed-77f1-40d6-b2b2-b442090fa9de', 'volume_name': 'volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8f049e-5491-456e-a958-2e7bd9da64fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8f049e-5491-456e-a958-2e7bd9da64fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7502b4bf-c85b-4e3b-924d-047c8c068c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:45 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Volume 7666a2ed-77f1-40d6-b2b2-b442090fa9de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de', 'volume_size': 1} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1620430526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7666a2ed-77f1-40d6-b2b2-b442090fa9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31692cb470d742bc85e931ee2fa8ff4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:11:46Z,use_quota=True,user_id='48db0d4f057f4dc9b0f49b661f3f695d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Creating volume 7666a2ed-77f1-40d6-b2b2-b442090fa9de {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:11:45 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Lock "cinder-a3bd8eff-d3e8-404b-ba7e-eca471f512f9-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:11:45 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de 1073741824 Jun 11 05:11:45 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Acquiring lock "cinder-quobyte-a3bd8eff-d3e8-404b-ba7e-eca471f512f9" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Lock "cinder-quobyte-a3bd8eff-d3e8-404b-ba7e-eca471f512f9" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[55704cdc-8bd8-41b2-aaf3-6e8902d9f2ca]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:11:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:46 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9 Jun 11 05:11:46 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:46 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de 1073741824" returned: 0 in 1.120s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:46 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9" returned: 0 in 1.064s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:46 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9 Jun 11 05:11:46 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:46 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de Jun 11 05:11:46 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:47 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a3bd8eff-d3e8-404b-ba7e-eca471f512f9" returned: 0 in 0.935s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Lock "cinder-quobyte-a3bd8eff-d3e8-404b-ba7e-eca471f512f9" released by "delete_volume" :: held 2.064s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG cinder.quota [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Created reservations ['ec277d9e-436d-4dcb-b4bb-6bb7ea29c831', '61a47e30-7e9f-4e5b-9831-50bca0920fa8', 'a43854f3-227d-4ded-9985-32427351d15c', '90c545ee-af1a-4b15-a815-1ae854c72a91'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:11:48 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de" returned: 0 in 1.161s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] <== create_volume: return (2371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.374s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7502b4bf-c85b-4e3b-924d-047c8c068c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48afec3c-0b06-4494-9916-932b5b6a753b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:48 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Volume volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de (7666a2ed-77f1-40d6-b2b2-b442090fa9de): created successfully Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48afec3c-0b06-4494-9916-932b5b6a753b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Flow 'volume_create_manager' (de04b2d6-80a5-4c34-a165-399e6be6195a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:48 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-3595450f-d53f-46a6-812c-028d210e76a7 req-1fc8a28b-8d6c-4dcb-ad25-22f65d4326a5 tempest-VolumesSnapshotsTestJSON-1629436985 None] Created volume successfully. Jun 11 05:11:48 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:11:48 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:48 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.661s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG cinder.manager [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:11:48 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Deleted volume successfully. Jun 11 05:11:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-1652b4b0-7ef7-441e-824e-ee9ba3cc8be0 req-f100bb4c-588b-4d40-982e-63d556b41787 tempest-VolumesGetTestJSON-1419690703 None] Lock "cinder-a3bd8eff-d3e8-404b-ba7e-eca471f512f9-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:11:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:49 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] Creating offline snapshot 437338cc-091b-4471-9e79-5ee161e45a73 of volume 7666a2ed-77f1-40d6-b2b2-b442090fa9de {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:11:49 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1fd58c-0bbf-45ed-820b-48b0a24cbcf5]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:11:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:49 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de Jun 11 05:11:49 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:50 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de" returned: 0 in 0.996s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:50 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 1G Jun 11 05:11:50 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:51 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 1G" returned: 0 in 1.140s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:51 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 Jun 11 05:11:51 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:52 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73" returned: 0 in 0.889s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:52 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 is being set with open permissions: ugo+rw Jun 11 05:11:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:52 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 Jun 11 05:11:52 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:53 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73" returned: 0 in 0.888s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:53 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.info Jun 11 05:11:53 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:54 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.info" returned: 0 in 0.652s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:54 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.info is being set with open permissions: ugo+rw Jun 11 05:11:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:54 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.info Jun 11 05:11:54 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:55 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8756a6ad-f656-4d23-a429-8840a4c0a7c1 tempest-GroupsTest-1573236862 None] Group tempest-Group1-406531168: creating Jun 11 05:11:55 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8756a6ad-f656-4d23-a429-8840a4c0a7c1 tempest-GroupsTest-1573236862 None] Group tempest-Group1-406531168: created successfully Jun 11 05:11:55 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8756a6ad-f656-4d23-a429-8840a4c0a7c1 tempest-GroupsTest-1573236862 None] Create group completed successfully. Jun 11 05:11:55 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.info" returned: 0 in 0.999s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.719s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:55 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-02b56172-70ec-4b64-b783-c29ded94a0bc req-2507a69f-ac0b-45be-9019-9d5d45417e0c tempest-VolumesSnapshotsTestJSON-1629436985 None] Create snapshot completed successfully Jun 11 05:11:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Acquiring lock "cinder-437338cc-091b-4471-9e79-5ee161e45a73-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:11:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "cinder-437338cc-091b-4471-9e79-5ee161e45a73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:11:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Acquiring lock "cinder-quobyte-7666a2ed-77f1-40d6-b2b2-b442090fa9de" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:11:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "cinder-quobyte-7666a2ed-77f1-40d6-b2b2-b442090fa9de" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:11:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Acquiring lock "cinder-quobyte-437338cc-091b-4471-9e79-5ee161e45a73" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:11:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "cinder-quobyte-437338cc-091b-4471-9e79-5ee161e45a73" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:11:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Deleting offline snapshot 437338cc-091b-4471-9e79-5ee161e45a73 of volume 7666a2ed-77f1-40d6-b2b2-b442090fa9de {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:11:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] snapshot_file for this snap is: volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:11:55 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6f956a-d53e-4ecb-ae7e-549b52f3c419]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:11:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:55 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 Jun 11 05:11:55 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:56 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-95292793-f1cb-42e0-94a3-09c679acbdea tempest-GroupsTest-1573236862 None] Group tempest-Group2-2113044224: creating Jun 11 05:11:56 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73" returned: 0 in 0.891s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:11:56 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-95292793-f1cb-42e0-94a3-09c679acbdea tempest-GroupsTest-1573236862 None] Group tempest-Group2-2113044224: created successfully Jun 11 05:11:56 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-95292793-f1cb-42e0-94a3-09c679acbdea tempest-GroupsTest-1573236862 None] Create group completed successfully. Jun 11 05:11:56 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdf94d5-c98b-4288-8d68-895656ad5902]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:11:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:56 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de Jun 11 05:11:56 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:57 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de" returned: 0 in 0.739s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:57 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 Jun 11 05:11:57 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:58 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73" returned: 0 in 0.745s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:58 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73 Jun 11 05:11:58 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Flow 'volume_create_manager' (79d3f1f5-87f9-4298-84b9-92850d0f92a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a77466-0054-421c-8868-10551f775157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a77466-0054-421c-8868-10551f775157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814198863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6088bdf5-2457-41fd-ad89-dd400b70af91,host='devstack@QuobyteHD#QuobyteHD',id=6ff19c26-5595-4ad1-b8d1-6590f7e3d615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff47733f294e5ebd6a6f794d2b8d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:11:58Z,use_quota=True,user_id='642164492cea40c69f5649c6f05501a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c777f28-b312-469f-a24a-377c676badd1),volume_type_id=9c777f28-b312-469f-a24a-377c676badd1)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0caf5a-d554-449d-ac6f-dc16683bf158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0caf5a-d554-449d-ac6f-dc16683bf158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8570f91e-edce-416c-ace1-ea139192add3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8570f91e-edce-416c-ace1-ea139192add3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff19c26-5595-4ad1-b8d1-6590f7e3d615', 'volume_name': 'volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0873c1e-371f-468f-80f3-7aeb6351c4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0873c1e-371f-468f-80f3-7aeb6351c4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bceef4bd-6b5f-4b90-a6af-427a016ba6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:58 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Volume 6ff19c26-5595-4ad1-b8d1-6590f7e3d615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615', 'volume_size': 1} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6088bdf5-2457-41fd-ad89-dd400b70af91,created_at=2026-06-11T03:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814198863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6088bdf5-2457-41fd-ad89-dd400b70af91,host='devstack@QuobyteHD#QuobyteHD',id=6ff19c26-5595-4ad1-b8d1-6590f7e3d615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff47733f294e5ebd6a6f794d2b8d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:11:58Z,use_quota=True,user_id='642164492cea40c69f5649c6f05501a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c777f28-b312-469f-a24a-377c676badd1),volume_type_id=9c777f28-b312-469f-a24a-377c676badd1)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Creating volume 6ff19c26-5595-4ad1-b8d1-6590f7e3d615 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:11:58 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:58 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615 1073741824 Jun 11 05:11:58 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:58 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de.437338cc-091b-4471-9e79-5ee161e45a73" returned: 0 in 0.841s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "cinder-quobyte-437338cc-091b-4471-9e79-5ee161e45a73" released by "_delete_snapshot" :: held 3.386s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "cinder-quobyte-7666a2ed-77f1-40d6-b2b2-b442090fa9de" released by "delete_snapshot" :: held 3.437s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:11:59 devstack cinder-volume[92308]: WARNING cinder.quota [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG cinder.quota [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Created reservations ['1910222d-de78-4185-a9ac-47ecf7cf51e2', '9e2e3245-84c5-4bf2-9387-dd5db25ecb6b', 'c7a4fd58-2ef9-4da1-bae0-db26d9dbf588', '602b3c2a-1e00-47d4-8642-eed6d199594b'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:11:59 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Delete snapshot completed successfully. Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-4d342b68-d41f-4631-bf10-a789f16fa42f req-3a02f039-acc0-4db6-b627-aaa5dac560e8 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "cinder-437338cc-091b-4471-9e79-5ee161e45a73-delete_snapshot" released by "delete_snapshot" :: held 3.658s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:11:59 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615 1073741824" returned: 0 in 0.937s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:11:59 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615 Jun 11 05:11:59 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:11:59 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615" returned: 0 in 0.638s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bceef4bd-6b5f-4b90-a6af-427a016ba6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16d319f-4810-40fc-9843-b0efab4a0e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:11:59 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Volume volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615 (6ff19c26-5595-4ad1-b8d1-6590f7e3d615): created successfully Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16d319f-4810-40fc-9843-b0efab4a0e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Flow 'volume_create_manager' (79d3f1f5-87f9-4298-84b9-92850d0f92a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:11:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Acquiring lock "cinder-7666a2ed-77f1-40d6-b2b2-b442090fa9de-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:00 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9825f7c8-8533-4d2c-b61d-64460cab3484 tempest-GroupsTest-1573236862 None] Created volume successfully. Jun 11 05:12:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "cinder-7666a2ed-77f1-40d6-b2b2-b442090fa9de-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Acquiring lock "cinder-quobyte-7666a2ed-77f1-40d6-b2b2-b442090fa9de" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "cinder-quobyte-7666a2ed-77f1-40d6-b2b2-b442090fa9de" acquired by "delete_volume" :: waited 0.014s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6b1777-89a4-4e14-bbf2-27420058fc71]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:00 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de Jun 11 05:12:00 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:00 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de" returned: 0 in 0.724s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:00 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de Jun 11 05:12:00 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Acquiring lock "cinder-quobyte-6ff19c26-5595-4ad1-b8d1-6590f7e3d615" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Lock "cinder-quobyte-6ff19c26-5595-4ad1-b8d1-6590f7e3d615" acquired by "delete_volume" :: waited 0.031s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[86609d69-1f7f-4c28-86aa-d526ce94e806]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:01 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615 Jun 11 05:12:01 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:01 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7666a2ed-77f1-40d6-b2b2-b442090fa9de" returned: 0 in 0.610s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "cinder-quobyte-7666a2ed-77f1-40d6-b2b2-b442090fa9de" released by "delete_volume" :: held 1.420s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG cinder.quota [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Created reservations ['532203b0-4ae9-44ea-988a-6e504ac308b9', '1c7fee68-9be3-4a1b-b6de-1655e14e7065', 'ed1c9270-1a60-472d-bf58-2e78c3577513', '84fccd9e-e7c7-4cb3-abb5-68afd25f62cb'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:01 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:12:01 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:01 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615" returned: 0 in 0.782s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:01 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615 Jun 11 05:12:01 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:02 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.673s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:02 devstack cinder-volume[92308]: DEBUG cinder.manager [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:12:02 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Deleted volume successfully. Jun 11 05:12:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-ffa41db8-3959-412b-ba5d-6f95e6dd4c0f req-938330e6-4896-44ec-9923-c6b2cccb0329 tempest-VolumesSnapshotsTestJSON-1629436985 None] Lock "cinder-7666a2ed-77f1-40d6-b2b2-b442090fa9de-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:02 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff19c26-5595-4ad1-b8d1-6590f7e3d615" returned: 0 in 0.703s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Lock "cinder-quobyte-6ff19c26-5595-4ad1-b8d1-6590f7e3d615" released by "delete_volume" :: held 1.541s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:02 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Created reservations ['43cdb384-5feb-4193-b27e-722b3e332970'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:12:02 devstack cinder-volume[92308]: WARNING cinder.quota [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2035505662 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2035505662, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:12:02 devstack cinder-volume[92308]: WARNING cinder.quota [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2035505662 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2035505662, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:12:02 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Created reservations ['5df866a1-3bc0-45a7-a0d5-29270d42f4b7', '27b92196-a578-44a0-a9df-e1c919d8b46e', '0a863e8a-307a-42c7-ae3d-9cea5e97b95f', '7b7dc5f0-2b1f-4a0d-a425-12ec00861e65'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:12:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:02 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:12:02 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:03 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-5b975396-7765-4ca0-9fee-96b508bede6a tempest-GroupsTest-1573236862 None] Created reservations ['b20ac339-b2e2-463b-8103-c7d4cf18eb17'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:12:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5b975396-7765-4ca0-9fee-96b508bede6a tempest-GroupsTest-1573236862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5b975396-7765-4ca0-9fee-96b508bede6a tempest-GroupsTest-1573236862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5b975396-7765-4ca0-9fee-96b508bede6a tempest-GroupsTest-1573236862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:03 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5b975396-7765-4ca0-9fee-96b508bede6a tempest-GroupsTest-1573236862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5b975396-7765-4ca0-9fee-96b508bede6a tempest-GroupsTest-1573236862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5b975396-7765-4ca0-9fee-96b508bede6a tempest-GroupsTest-1573236862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.860s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:03 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:12:03 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-94a490b9-60a3-402b-b29e-1e2a81707542 tempest-GroupsTest-1573236862 None] Delete group completed successfully. Jun 11 05:12:03 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:12:03 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:04 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5b975396-7765-4ca0-9fee-96b508bede6a tempest-GroupsTest-1573236862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.857s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:04 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-5b975396-7765-4ca0-9fee-96b508bede6a tempest-GroupsTest-1573236862 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:12:04 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5b975396-7765-4ca0-9fee-96b508bede6a tempest-GroupsTest-1573236862 None] Delete group completed successfully. Jun 11 05:12:05 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-94bc05fe-a5ec-46ef-b333-79178f0058be tempest-GroupsTest-1573236862 None] Group tempest-GroupsTest-Group-2054041237: creating Jun 11 05:12:05 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-94bc05fe-a5ec-46ef-b333-79178f0058be tempest-GroupsTest-1573236862 None] Group tempest-GroupsTest-Group-2054041237: created successfully Jun 11 05:12:05 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-94bc05fe-a5ec-46ef-b333-79178f0058be tempest-GroupsTest-1573236862 None] Create group completed successfully. Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Flow 'volume_create_manager' (a73f577e-24bf-442e-9f04-3af8136d899c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9596ed37-65ff-4b26-a86e-84d4b2f9d7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9596ed37-65ff-4b26-a86e-84d4b2f9d7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1475798598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c26658-9878-41b1-a4f0-53dddce8cf0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbc0e408b3c84a3eb45b9a4c9708413c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:07Z,use_quota=True,user_id='4ae0da42294c4034948d9c5fecf17e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7c1762-87f7-409a-ae3d-75a28c62c0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7c1762-87f7-409a-ae3d-75a28c62c0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89403af8-5277-425f-9d5a-088ef025b585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89403af8-5277-425f-9d5a-088ef025b585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80c26658-9878-41b1-a4f0-53dddce8cf0e', 'volume_name': 'volume-80c26658-9878-41b1-a4f0-53dddce8cf0e', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349b361d-edfe-4da7-83cd-c5e691f38f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349b361d-edfe-4da7-83cd-c5e691f38f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd5a247-6d19-46bc-9088-0fa4e1429028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:07 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Volume 80c26658-9878-41b1-a4f0-53dddce8cf0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80c26658-9878-41b1-a4f0-53dddce8cf0e', 'volume_size': 1} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1475798598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c26658-9878-41b1-a4f0-53dddce8cf0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbc0e408b3c84a3eb45b9a4c9708413c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:07Z,use_quota=True,user_id='4ae0da42294c4034948d9c5fecf17e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Creating volume 80c26658-9878-41b1-a4f0-53dddce8cf0e {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:12:07 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80c26658-9878-41b1-a4f0-53dddce8cf0e 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:07 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80c26658-9878-41b1-a4f0-53dddce8cf0e 1073741824 Jun 11 05:12:07 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Flow 'volume_create_manager' (ed8981f4-41c7-4934-9093-b81ed18dbce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f453c0-ad6d-446f-9511-f80d8f37e0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f453c0-ad6d-446f-9511-f80d8f37e0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1343166805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69403f0b-75d0-4a0c-a045-5bb7da266891,host='devstack@QuobyteHD#QuobyteHD',id=1668182f-ff45-49a3-960b-9703684a8601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff47733f294e5ebd6a6f794d2b8d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:08Z,use_quota=True,user_id='642164492cea40c69f5649c6f05501a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eceb37f5-4316-4981-9101-d236c9be9860),volume_type_id=eceb37f5-4316-4981-9101-d236c9be9860)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d75e47-bbbf-4d69-bdb5-2576e045df5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d75e47-bbbf-4d69-bdb5-2576e045df5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25747ab5-f28a-41d6-ab20-aae5d5e8533a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25747ab5-f28a-41d6-ab20-aae5d5e8533a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1668182f-ff45-49a3-960b-9703684a8601', 'volume_name': 'volume-1668182f-ff45-49a3-960b-9703684a8601', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08589ee6-c47c-4641-b77f-e877c933fb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08589ee6-c47c-4641-b77f-e877c933fb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1aad5c-ad1d-445a-a0f8-9b7e7958be97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:07 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Volume 1668182f-ff45-49a3-960b-9703684a8601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1668182f-ff45-49a3-960b-9703684a8601', 'volume_size': 1} Jun 11 05:12:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:08 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80c26658-9878-41b1-a4f0-53dddce8cf0e 1073741824" returned: 0 in 0.959s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80c26658-9878-41b1-a4f0-53dddce8cf0e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:08 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80c26658-9878-41b1-a4f0-53dddce8cf0e Jun 11 05:12:08 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:09 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80c26658-9878-41b1-a4f0-53dddce8cf0e" returned: 0 in 0.662s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.406s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=69403f0b-75d0-4a0c-a045-5bb7da266891,created_at=2026-06-11T03:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1343166805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69403f0b-75d0-4a0c-a045-5bb7da266891,host='devstack@QuobyteHD#QuobyteHD',id=1668182f-ff45-49a3-960b-9703684a8601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff47733f294e5ebd6a6f794d2b8d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:08Z,use_quota=True,user_id='642164492cea40c69f5649c6f05501a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eceb37f5-4316-4981-9101-d236c9be9860),volume_type_id=eceb37f5-4316-4981-9101-d236c9be9860)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Creating volume 1668182f-ff45-49a3-960b-9703684a8601 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:12:09 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1668182f-ff45-49a3-960b-9703684a8601 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd5a247-6d19-46bc-9088-0fa4e1429028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c26658-9878-41b1-a4f0-53dddce8cf0e', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:09 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1668182f-ff45-49a3-960b-9703684a8601 1073741824 Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc8609d-d3a2-4de0-8fbd-ed4076cee129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:09 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:09 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Volume volume-80c26658-9878-41b1-a4f0-53dddce8cf0e (80c26658-9878-41b1-a4f0-53dddce8cf0e): created successfully Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc8609d-d3a2-4de0-8fbd-ed4076cee129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Flow 'volume_create_manager' (a73f577e-24bf-442e-9f04-3af8136d899c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:09 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2c5b8e56-2547-431a-a108-d1421d6a7d87 tempest-VolumesTestJSON-106069948 None] Created volume successfully. Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:12:10 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Flow 'volume_create_manager' (d61ee6fe-43dd-4a3c-9312-04b6b76e9bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f78ea22-98ca-4529-8c30-de58803332e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1668182f-ff45-49a3-960b-9703684a8601 1073741824" returned: 0 in 1.073s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f78ea22-98ca-4529-8c30-de58803332e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-979636682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170df1bb-5170-4254-b452-b5ee5bbc62d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbc0e408b3c84a3eb45b9a4c9708413c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:10Z,use_quota=True,user_id='4ae0da42294c4034948d9c5fecf17e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b8344c-e0d8-4d4d-bd83-88a5bb923b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b8344c-e0d8-4d4d-bd83-88a5bb923b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1151261e-cea0-4591-8ae3-6649c1660df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1151261e-cea0-4591-8ae3-6649c1660df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '170df1bb-5170-4254-b452-b5ee5bbc62d6', 'volume_name': 'volume-170df1bb-5170-4254-b452-b5ee5bbc62d6', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32759ca8-900d-4810-8510-c3ed08ef2022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32759ca8-900d-4810-8510-c3ed08ef2022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc32f063-67f1-46e2-b815-b4037bb52223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:10 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Volume 170df1bb-5170-4254-b452-b5ee5bbc62d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-170df1bb-5170-4254-b452-b5ee5bbc62d6', 'volume_size': 1} Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1668182f-ff45-49a3-960b-9703684a8601 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:10 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1668182f-ff45-49a3-960b-9703684a8601 Jun 11 05:12:10 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:11 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1668182f-ff45-49a3-960b-9703684a8601" returned: 0 in 0.682s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.709s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-979636682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170df1bb-5170-4254-b452-b5ee5bbc62d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbc0e408b3c84a3eb45b9a4c9708413c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:10Z,use_quota=True,user_id='4ae0da42294c4034948d9c5fecf17e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Creating volume 170df1bb-5170-4254-b452-b5ee5bbc62d6 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:12:11 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-170df1bb-5170-4254-b452-b5ee5bbc62d6 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1aad5c-ad1d-445a-a0f8-9b7e7958be97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1668182f-ff45-49a3-960b-9703684a8601', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2009f559-9281-476a-a242-419f293f9091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:11 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-170df1bb-5170-4254-b452-b5ee5bbc62d6 1073741824 Jun 11 05:12:11 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:11 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Volume volume-1668182f-ff45-49a3-960b-9703684a8601 (1668182f-ff45-49a3-960b-9703684a8601): created successfully Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2009f559-9281-476a-a242-419f293f9091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Flow 'volume_create_manager' (ed8981f4-41c7-4934-9093-b81ed18dbce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:11 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-229e9748-73c2-42c6-b1b6-ab5cc66953a2 tempest-GroupsTest-1573236862 None] Created volume successfully. Jun 11 05:12:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-742db25f-9cc4-44d7-bed6-c1762bf93e29 req-bcc4a367-15d1-46a4-a237-4e19a1d5fdc9 tempest-ServerActionsTestOtherA-987815009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:12 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-170df1bb-5170-4254-b452-b5ee5bbc62d6 1073741824" returned: 0 in 0.846s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-170df1bb-5170-4254-b452-b5ee5bbc62d6 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:12 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-170df1bb-5170-4254-b452-b5ee5bbc62d6 Jun 11 05:12:12 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:12 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-170df1bb-5170-4254-b452-b5ee5bbc62d6" returned: 0 in 0.630s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-742db25f-9cc4-44d7-bed6-c1762bf93e29 req-bcc4a367-15d1-46a4-a237-4e19a1d5fdc9 tempest-ServerActionsTestOtherA-987815009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.893s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc32f063-67f1-46e2-b815-b4037bb52223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-170df1bb-5170-4254-b452-b5ee5bbc62d6', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612f6233-c094-44c0-83e9-7cd1a850c76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[11216d18-212a-4fee-a977-74a8f352044d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-742db25f-9cc4-44d7-bed6-c1762bf93e29 req-bcc4a367-15d1-46a4-a237-4e19a1d5fdc9 tempest-ServerActionsTestOtherA-987815009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:12 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Volume volume-170df1bb-5170-4254-b452-b5ee5bbc62d6 (170df1bb-5170-4254-b452-b5ee5bbc62d6): created successfully Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612f6233-c094-44c0-83e9-7cd1a850c76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Flow 'volume_create_manager' (d61ee6fe-43dd-4a3c-9312-04b6b76e9bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Flow 'volume_create_manager' (2058fbf3-2225-420c-a510-1a5d8a680709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97974b75-20a6-4b23-949c-9c4322249f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:12 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 Jun 11 05:12:12 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:12 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8e92e2f6-0301-4184-aefd-ecbb202ad655 tempest-VolumesTestJSON-106069948 None] Created volume successfully. Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97974b75-20a6-4b23-949c-9c4322249f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2031940706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69403f0b-75d0-4a0c-a045-5bb7da266891,host='devstack@QuobyteHD#QuobyteHD',id=1194ad89-f566-43c6-8e7f-2ee2255850cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff47733f294e5ebd6a6f794d2b8d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:13Z,use_quota=True,user_id='642164492cea40c69f5649c6f05501a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eceb37f5-4316-4981-9101-d236c9be9860),volume_type_id=eceb37f5-4316-4981-9101-d236c9be9860)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a176ed0a-d4a1-4f53-b7da-6d7b1b29c6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a176ed0a-d4a1-4f53-b7da-6d7b1b29c6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdd598c-ea8e-416b-96cf-f076027f9430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdd598c-ea8e-416b-96cf-f076027f9430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1194ad89-f566-43c6-8e7f-2ee2255850cc', 'volume_name': 'volume-1194ad89-f566-43c6-8e7f-2ee2255850cc', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3b33df-a420-4775-92f3-d9663efa9b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3b33df-a420-4775-92f3-d9663efa9b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e179a11-546a-461c-a1d4-fa49fa547534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:12 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Volume 1194ad89-f566-43c6-8e7f-2ee2255850cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1194ad89-f566-43c6-8e7f-2ee2255850cc', 'volume_size': 1} Jun 11 05:12:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:13 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-742db25f-9cc4-44d7-bed6-c1762bf93e29 req-bcc4a367-15d1-46a4-a237-4e19a1d5fdc9 tempest-ServerActionsTestOtherA-987815009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04" returned: 0 in 0.729s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-742db25f-9cc4-44d7-bed6-c1762bf93e29 req-bcc4a367-15d1-46a4-a237-4e19a1d5fdc9 tempest-ServerActionsTestOtherA-987815009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.772s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=69403f0b-75d0-4a0c-a045-5bb7da266891,created_at=2026-06-11T03:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2031940706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69403f0b-75d0-4a0c-a045-5bb7da266891,host='devstack@QuobyteHD#QuobyteHD',id=1194ad89-f566-43c6-8e7f-2ee2255850cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff47733f294e5ebd6a6f794d2b8d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:13Z,use_quota=True,user_id='642164492cea40c69f5649c6f05501a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eceb37f5-4316-4981-9101-d236c9be9860),volume_type_id=eceb37f5-4316-4981-9101-d236c9be9860)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:12:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Creating volume 1194ad89-f566-43c6-8e7f-2ee2255850cc {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:12:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:12:13 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:12:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1194ad89-f566-43c6-8e7f-2ee2255850cc 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:13 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1194ad89-f566-43c6-8e7f-2ee2255850cc 1073741824 Jun 11 05:12:13 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-742db25f-9cc4-44d7-bed6-c1762bf93e29 req-bcc4a367-15d1-46a4-a237-4e19a1d5fdc9 tempest-ServerActionsTestOtherA-987815009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8942535f-8111-4153-ac73-f9053e6f363c', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:12:13 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-742db25f-9cc4-44d7-bed6-c1762bf93e29 req-bcc4a367-15d1-46a4-a237-4e19a1d5fdc9 tempest-ServerActionsTestOtherA-987815009 None] attachment_update completed successfully. Jun 11 05:12:14 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1194ad89-f566-43c6-8e7f-2ee2255850cc 1073741824" returned: 0 in 0.906s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1194ad89-f566-43c6-8e7f-2ee2255850cc {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:14 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1194ad89-f566-43c6-8e7f-2ee2255850cc Jun 11 05:12:14 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Flow 'volume_create_manager' (ac3b3cdc-4f4c-4c76-8cde-2ad32a404bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2899de28-2e83-421e-bd69-e721905e777a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2899de28-2e83-421e-bd69-e721905e777a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2109521109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596c271a-503e-4984-b89c-2400e0e560bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbc0e408b3c84a3eb45b9a4c9708413c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:14Z,use_quota=True,user_id='4ae0da42294c4034948d9c5fecf17e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153271b9-b9f1-4092-a865-c03f46421c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153271b9-b9f1-4092-a865-c03f46421c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31cb207-0fc6-471b-ace1-fd97ed4fcad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31cb207-0fc6-471b-ace1-fd97ed4fcad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '596c271a-503e-4984-b89c-2400e0e560bd', 'volume_name': 'volume-596c271a-503e-4984-b89c-2400e0e560bd', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c76948d-f2ec-4913-95ca-088dd54fd75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c76948d-f2ec-4913-95ca-088dd54fd75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662bd70c-b307-41f1-b3bb-6592993508ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:14 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Volume 596c271a-503e-4984-b89c-2400e0e560bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-596c271a-503e-4984-b89c-2400e0e560bd', 'volume_size': 1} Jun 11 05:12:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:15 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1194ad89-f566-43c6-8e7f-2ee2255850cc" returned: 0 in 0.653s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2109521109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596c271a-503e-4984-b89c-2400e0e560bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbc0e408b3c84a3eb45b9a4c9708413c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:14Z,use_quota=True,user_id='4ae0da42294c4034948d9c5fecf17e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Creating volume 596c271a-503e-4984-b89c-2400e0e560bd {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:12:15 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-596c271a-503e-4984-b89c-2400e0e560bd 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:15 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-596c271a-503e-4984-b89c-2400e0e560bd 1073741824 Jun 11 05:12:15 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e179a11-546a-461c-a1d4-fa49fa547534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1194ad89-f566-43c6-8e7f-2ee2255850cc', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394dfd83-39b9-458e-ada9-475e989f38b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:15 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Volume volume-1194ad89-f566-43c6-8e7f-2ee2255850cc (1194ad89-f566-43c6-8e7f-2ee2255850cc): created successfully Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394dfd83-39b9-458e-ada9-475e989f38b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Flow 'volume_create_manager' (2058fbf3-2225-420c-a510-1a5d8a680709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:15 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-33f7dee8-cf4f-4c70-b7f4-eecf8adcc3ae tempest-GroupsTest-1573236862 None] Created volume successfully. Jun 11 05:12:15 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-596c271a-503e-4984-b89c-2400e0e560bd 1073741824" returned: 0 in 0.740s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-596c271a-503e-4984-b89c-2400e0e560bd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:15 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-596c271a-503e-4984-b89c-2400e0e560bd Jun 11 05:12:15 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:16 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f909b574-b628-4628-af8f-b6a7f2041e49 tempest-GroupsTest-1573236862 None] Update group completed successfully. Jun 11 05:12:16 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-596c271a-503e-4984-b89c-2400e0e560bd" returned: 0 in 0.601s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:16 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:12:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:16 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662bd70c-b307-41f1-b3bb-6592993508ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-596c271a-503e-4984-b89c-2400e0e560bd', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:16 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b353ef9b-cebc-4715-ad4c-9f3ac1c9f0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:16 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Volume volume-596c271a-503e-4984-b89c-2400e0e560bd (596c271a-503e-4984-b89c-2400e0e560bd): created successfully Jun 11 05:12:16 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b353ef9b-cebc-4715-ad4c-9f3ac1c9f0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:16 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Flow 'volume_create_manager' (ac3b3cdc-4f4c-4c76-8cde-2ad32a404bfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:16 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-451dcc23-b1d3-47cc-a3b6-c8d2f6e7dcdd tempest-VolumesTestJSON-106069948 None] Created volume successfully. Jun 11 05:12:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Acquiring lock "cinder-596c271a-503e-4984-b89c-2400e0e560bd-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Lock "cinder-596c271a-503e-4984-b89c-2400e0e560bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Acquiring lock "cinder-quobyte-596c271a-503e-4984-b89c-2400e0e560bd" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Lock "cinder-quobyte-596c271a-503e-4984-b89c-2400e0e560bd" acquired by "delete_volume" :: waited 0.043s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:17 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[67afbc11-d19b-46b4-9aca-c9f201ff2d0d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-596c271a-503e-4984-b89c-2400e0e560bd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:17 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-596c271a-503e-4984-b89c-2400e0e560bd Jun 11 05:12:17 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:17 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b653a060-0766-48d8-bbf6-e3af03d2503b tempest-GroupsTest-1573236862 None] Update group completed successfully. Jun 11 05:12:18 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-596c271a-503e-4984-b89c-2400e0e560bd" returned: 0 in 0.852s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-596c271a-503e-4984-b89c-2400e0e560bd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:18 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-596c271a-503e-4984-b89c-2400e0e560bd Jun 11 05:12:18 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:19 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-596c271a-503e-4984-b89c-2400e0e560bd" returned: 0 in 0.596s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Lock "cinder-quobyte-596c271a-503e-4984-b89c-2400e0e560bd" released by "delete_volume" :: held 1.498s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Created reservations ['34c35749-5baf-431a-9f85-0a9de191df4d', 'ef5585d4-bf52-4ada-a373-cd034bfef760', 'ef1ecee8-26ee-4239-8d10-ca85e344b9d7', '409b7b46-a204-4cb9-a8ae-203153c9bf80'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:19 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:12:19 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Acquiring lock "cinder-quobyte-1194ad89-f566-43c6-8e7f-2ee2255850cc" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Lock "cinder-quobyte-1194ad89-f566-43c6-8e7f-2ee2255850cc" acquired by "delete_volume" :: waited 0.034s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[173ba81c-0472-4182-8cce-3695112fa012]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1194ad89-f566-43c6-8e7f-2ee2255850cc {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:19 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1194ad89-f566-43c6-8e7f-2ee2255850cc Jun 11 05:12:19 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Acquiring lock "cinder-170df1bb-5170-4254-b452-b5ee5bbc62d6-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Lock "cinder-170df1bb-5170-4254-b452-b5ee5bbc62d6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Acquiring lock "cinder-quobyte-170df1bb-5170-4254-b452-b5ee5bbc62d6" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Lock "cinder-quobyte-170df1bb-5170-4254-b452-b5ee5bbc62d6" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c7ea9f-5a80-4aa8-8091-1912d4f48985]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-170df1bb-5170-4254-b452-b5ee5bbc62d6 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:19 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.717s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:12:19 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Deleted volume successfully. Jun 11 05:12:19 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-170df1bb-5170-4254-b452-b5ee5bbc62d6 Jun 11 05:12:19 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-89498587-dd92-4d53-8b66-8ec62a278367 tempest-VolumesTestJSON-106069948 None] Lock "cinder-596c271a-503e-4984-b89c-2400e0e560bd-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:20 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1194ad89-f566-43c6-8e7f-2ee2255850cc" returned: 0 in 0.832s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1194ad89-f566-43c6-8e7f-2ee2255850cc {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:20 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1194ad89-f566-43c6-8e7f-2ee2255850cc Jun 11 05:12:20 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:20 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-170df1bb-5170-4254-b452-b5ee5bbc62d6" returned: 0 in 0.759s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-170df1bb-5170-4254-b452-b5ee5bbc62d6 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:20 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-170df1bb-5170-4254-b452-b5ee5bbc62d6 Jun 11 05:12:20 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:20 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1194ad89-f566-43c6-8e7f-2ee2255850cc" returned: 0 in 0.610s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Lock "cinder-quobyte-1194ad89-f566-43c6-8e7f-2ee2255850cc" released by "delete_volume" :: held 1.524s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Acquiring lock "cinder-quobyte-1668182f-ff45-49a3-960b-9703684a8601" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Lock "cinder-quobyte-1668182f-ff45-49a3-960b-9703684a8601" acquired by "delete_volume" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:20 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad923cf7-aab4-4a9a-81e7-f22bd2c375e9]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1668182f-ff45-49a3-960b-9703684a8601 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:21 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1668182f-ff45-49a3-960b-9703684a8601 Jun 11 05:12:21 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:21 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-170df1bb-5170-4254-b452-b5ee5bbc62d6" returned: 0 in 0.783s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Lock "cinder-quobyte-170df1bb-5170-4254-b452-b5ee5bbc62d6" released by "delete_volume" :: held 1.604s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=83,cinder:SELECT=87,cinder:INSERT=22,cinder:DELETE=6 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Created reservations ['697d1390-d1af-46a0-b823-970f10c510b1', '990e0950-6026-48b2-89b2-3cb737feb61f', '22d9d306-b375-4cad-a91a-f7c2ba37a083', '311c9cc0-9954-48f3-82de-ae332ad85f47'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:21 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:12:21 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:21 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-a6139231-3502-41c4-987f-8a65adf58fbd req-f278e712-b637-4401-a1f7-a5bd7cd930bf tempest-ServerActionsTestOtherA-987815009 None] Terminate volume connection completed successfully. Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-a6139231-3502-41c4-987f-8a65adf58fbd req-f278e712-b637-4401-a1f7-a5bd7cd930bf tempest-ServerActionsTestOtherA-987815009 None] Deleting attachment 8942535f-8111-4153-ac73-f9053e6f363c. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:12:21 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1668182f-ff45-49a3-960b-9703684a8601" returned: 0 in 1.023s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1668182f-ff45-49a3-960b-9703684a8601 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:21 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1668182f-ff45-49a3-960b-9703684a8601 Jun 11 05:12:21 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Acquiring lock "cinder-80c26658-9878-41b1-a4f0-53dddce8cf0e-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Lock "cinder-80c26658-9878-41b1-a4f0-53dddce8cf0e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Acquiring lock "cinder-quobyte-80c26658-9878-41b1-a4f0-53dddce8cf0e" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Lock "cinder-quobyte-80c26658-9878-41b1-a4f0-53dddce8cf0e" acquired by "delete_volume" :: waited 0.033s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc36566-0318-482f-8620-a44d058c5ca9]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80c26658-9878-41b1-a4f0-53dddce8cf0e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:22 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80c26658-9878-41b1-a4f0-53dddce8cf0e Jun 11 05:12:22 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:22 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.780s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:12:22 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Deleted volume successfully. Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f1fa68c4-9b16-4b95-848d-cc12371ff5ee tempest-VolumesTestJSON-106069948 None] Lock "cinder-170df1bb-5170-4254-b452-b5ee5bbc62d6-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:22 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1668182f-ff45-49a3-960b-9703684a8601" returned: 0 in 0.675s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Lock "cinder-quobyte-1668182f-ff45-49a3-960b-9703684a8601" released by "delete_volume" :: held 1.730s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Created reservations ['91a02585-453e-4498-8761-d4b31fcfbffc'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:12:22 devstack cinder-volume[92308]: WARNING cinder.quota [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1298061257 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1298061257, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:12:22 devstack cinder-volume[92308]: WARNING cinder.quota [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1298061257 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1298061257, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Created reservations ['b4637f8b-0294-4f6d-b509-0153f5cc2697', '5ea838c1-a4ce-4985-b917-f983a15f0a4d', '6b0dcd61-d6d1-426b-94ab-84241f48f6c4', '2864b94d-124b-4737-b7fd-bcc527bed44e'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Created reservations ['07619381-5cdf-46a0-8e0c-ea7b7f123a53', '1f20e107-629c-41f0-bdc3-4c063599fe45', '48dd98f4-c566-4476-8880-fe4bf94cb77a', '10f9595a-c037-4f49-b4be-c0f20cb12ae6'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:12:22 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80c26658-9878-41b1-a4f0-53dddce8cf0e" returned: 0 in 0.740s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80c26658-9878-41b1-a4f0-53dddce8cf0e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:22 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80c26658-9878-41b1-a4f0-53dddce8cf0e Jun 11 05:12:22 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=90,cinder:UPDATE=112,cinder:INSERT=22,cinder:DELETE=8 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:22 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:12:22 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:23 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80c26658-9878-41b1-a4f0-53dddce8cf0e" returned: 0 in 0.630s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Lock "cinder-quobyte-80c26658-9878-41b1-a4f0-53dddce8cf0e" released by "delete_volume" :: held 1.416s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:23 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:23 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Created reservations ['8fecc544-9339-484a-a5d5-3279f146399d', 'af8cbc5e-db76-4406-a18d-1c3e556429f8', '37110f19-4bdc-4878-878c-63f8229ba0f3', 'c821c835-b67b-47aa-848a-31d139db3dee'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:12:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.622s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:23 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:12:23 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3b9b5a70-e175-4153-9fce-4f8bed176bc7 tempest-GroupsTest-1573236862 None] Delete group completed successfully. Jun 11 05:12:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:23 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:12:23 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:24 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.598s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:24 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:12:24 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Deleted volume successfully. Jun 11 05:12:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c2c6bb75-f1b9-4198-960a-fa4f4a0d4171 tempest-VolumesTestJSON-106069948 None] Lock "cinder-80c26658-9878-41b1-a4f0-53dddce8cf0e-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-a6139231-3502-41c4-987f-8a65adf58fbd req-cb65080d-6c1a-4800-8b03-4ebdb86e9012 tempest-ServerActionsTestOtherA-987815009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-a6139231-3502-41c4-987f-8a65adf58fbd req-cb65080d-6c1a-4800-8b03-4ebdb86e9012 tempest-ServerActionsTestOtherA-987815009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:24 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d89d89b-e25e-4522-83ea-99826551bcea]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-a6139231-3502-41c4-987f-8a65adf58fbd req-cb65080d-6c1a-4800-8b03-4ebdb86e9012 tempest-ServerActionsTestOtherA-987815009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:24 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 Jun 11 05:12:24 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:25 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-a6139231-3502-41c4-987f-8a65adf58fbd req-cb65080d-6c1a-4800-8b03-4ebdb86e9012 tempest-ServerActionsTestOtherA-987815009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04" returned: 0 in 0.801s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-a6139231-3502-41c4-987f-8a65adf58fbd req-cb65080d-6c1a-4800-8b03-4ebdb86e9012 tempest-ServerActionsTestOtherA-987815009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.828s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-a6139231-3502-41c4-987f-8a65adf58fbd req-cb65080d-6c1a-4800-8b03-4ebdb86e9012 tempest-ServerActionsTestOtherA-987815009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd78be6e7-2059-4b98-91f1-c0f4a1b8de91', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:12:25 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-a6139231-3502-41c4-987f-8a65adf58fbd req-cb65080d-6c1a-4800-8b03-4ebdb86e9012 tempest-ServerActionsTestOtherA-987815009 None] attachment_update completed successfully. Jun 11 05:12:28 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5f40a2b2-1ffb-4c03-b57d-bc9caf9182ef tempest-GroupSnapshotsTest-62029582 None] Group tempest-GroupSnapshotsTest-Group-1795007713: creating Jun 11 05:12:28 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5f40a2b2-1ffb-4c03-b57d-bc9caf9182ef tempest-GroupSnapshotsTest-62029582 None] Group tempest-GroupSnapshotsTest-Group-1795007713: created successfully Jun 11 05:12:28 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5f40a2b2-1ffb-4c03-b57d-bc9caf9182ef tempest-GroupSnapshotsTest-62029582 None] Create group completed successfully. Jun 11 05:12:29 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f7e0c4d8-ed30-4e94-a758-b3db5d95c3f9 tempest-GroupsV320Test-1029449345 None] Group tempest-GroupsV320Test-Group-813105121: creating Jun 11 05:12:29 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f7e0c4d8-ed30-4e94-a758-b3db5d95c3f9 tempest-GroupsV320Test-1029449345 None] Group tempest-GroupsV320Test-Group-813105121: created successfully Jun 11 05:12:29 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f7e0c4d8-ed30-4e94-a758-b3db5d95c3f9 tempest-GroupsV320Test-1029449345 None] Create group completed successfully. Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:30 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:12:30 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Flow 'volume_create_manager' (4dc0f32d-c7c6-4d71-9841-af46790cc859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89b7325-c78c-4329-9a03-f17f807c808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89b7325-c78c-4329-9a03-f17f807c808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-479511370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9545a89-8fab-41dc-8e31-a073f710d695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a8805bbce14774ae751a0df59469ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:30Z,use_quota=True,user_id='2ce808ed1c0943a293406b0957b8397a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed536235-dc91-43cb-9ba1-be4157aae92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed536235-dc91-43cb-9ba1-be4157aae92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09428f3d-59f3-4cb8-a5c3-768b57dd0bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09428f3d-59f3-4cb8-a5c3-768b57dd0bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9545a89-8fab-41dc-8e31-a073f710d695', 'volume_name': 'volume-c9545a89-8fab-41dc-8e31-a073f710d695', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b253b1cd-d5c7-4863-93d5-92aa3231ce02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b253b1cd-d5c7-4863-93d5-92aa3231ce02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eaaa403-94e7-4ea9-a079-19616be14966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:30 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Volume c9545a89-8fab-41dc-8e31-a073f710d695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9545a89-8fab-41dc-8e31-a073f710d695', 'volume_size': 1} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-479511370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9545a89-8fab-41dc-8e31-a073f710d695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a8805bbce14774ae751a0df59469ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:30Z,use_quota=True,user_id='2ce808ed1c0943a293406b0957b8397a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Creating volume c9545a89-8fab-41dc-8e31-a073f710d695 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:12:30 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9545a89-8fab-41dc-8e31-a073f710d695 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:30 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9545a89-8fab-41dc-8e31-a073f710d695 1073741824 Jun 11 05:12:30 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Flow 'volume_create_manager' (6d92905a-eacc-49a9-898d-36b2dd5d2e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0caaf46e-d878-43b8-bb78-2521ab2cfad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0caaf46e-d878-43b8-bb78-2521ab2cfad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1008769282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4806e0e2-f20e-45e3-a895-75d5682817e1,host='devstack@QuobyteHD#QuobyteHD',id=15f038f6-084b-4478-9e96-e1559a477ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a434ca7ca16f4e64a6e606047ee70c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:30Z,use_quota=True,user_id='8940707c6a894afc90e79b189d0d1b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95f58122-032f-42c1-831b-23b29f81ecbc),volume_type_id=95f58122-032f-42c1-831b-23b29f81ecbc)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b303cd4-0162-47a0-97dd-7de93a231711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b303cd4-0162-47a0-97dd-7de93a231711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477d7e3e-f9bf-4227-834e-346cee721d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477d7e3e-f9bf-4227-834e-346cee721d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f038f6-084b-4478-9e96-e1559a477ec9', 'volume_name': 'volume-15f038f6-084b-4478-9e96-e1559a477ec9', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bec5cc1-89ec-4789-a7eb-17098c560ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bec5cc1-89ec-4789-a7eb-17098c560ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9d3cd5-1b3a-474b-a56e-2db468790220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:30 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Volume 15f038f6-084b-4478-9e96-e1559a477ec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f038f6-084b-4478-9e96-e1559a477ec9', 'volume_size': 1} Jun 11 05:12:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:31 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.908s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:12:31 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-636e487f-c3c6-4242-99af-c8664ea3eaed tempest-GroupsV320Test-1029449345 None] Created reservations ['0f9338c0-8cae-4cdd-b154-6ab4bb0f2fa3'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:12:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-636e487f-c3c6-4242-99af-c8664ea3eaed tempest-GroupsV320Test-1029449345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-636e487f-c3c6-4242-99af-c8664ea3eaed tempest-GroupsV320Test-1029449345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-636e487f-c3c6-4242-99af-c8664ea3eaed tempest-GroupsV320Test-1029449345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-636e487f-c3c6-4242-99af-c8664ea3eaed tempest-GroupsV320Test-1029449345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-636e487f-c3c6-4242-99af-c8664ea3eaed tempest-GroupsV320Test-1029449345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-636e487f-c3c6-4242-99af-c8664ea3eaed tempest-GroupsV320Test-1029449345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:31 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:12:31 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:31 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9545a89-8fab-41dc-8e31-a073f710d695 1073741824" returned: 0 in 1.266s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9545a89-8fab-41dc-8e31-a073f710d695 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:31 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9545a89-8fab-41dc-8e31-a073f710d695 Jun 11 05:12:31 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:32 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-636e487f-c3c6-4242-99af-c8664ea3eaed tempest-GroupsV320Test-1029449345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.726s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-636e487f-c3c6-4242-99af-c8664ea3eaed tempest-GroupsV320Test-1029449345 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:12:32 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-636e487f-c3c6-4242-99af-c8664ea3eaed tempest-GroupsV320Test-1029449345 None] Delete group completed successfully. Jun 11 05:12:32 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9545a89-8fab-41dc-8e31-a073f710d695" returned: 0 in 0.647s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.787s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4806e0e2-f20e-45e3-a895-75d5682817e1,created_at=2026-06-11T03:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1008769282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4806e0e2-f20e-45e3-a895-75d5682817e1,host='devstack@QuobyteHD#QuobyteHD',id=15f038f6-084b-4478-9e96-e1559a477ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a434ca7ca16f4e64a6e606047ee70c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:30Z,use_quota=True,user_id='8940707c6a894afc90e79b189d0d1b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95f58122-032f-42c1-831b-23b29f81ecbc),volume_type_id=95f58122-032f-42c1-831b-23b29f81ecbc)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Creating volume 15f038f6-084b-4478-9e96-e1559a477ec9 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:12:32 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eaaa403-94e7-4ea9-a079-19616be14966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9545a89-8fab-41dc-8e31-a073f710d695', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d90b45-13de-47ca-ba7e-cda8b795b582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:32 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 1073741824 Jun 11 05:12:32 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:32 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Volume volume-c9545a89-8fab-41dc-8e31-a073f710d695 (c9545a89-8fab-41dc-8e31-a073f710d695): created successfully Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d90b45-13de-47ca-ba7e-cda8b795b582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Flow 'volume_create_manager' (4dc0f32d-c7c6-4d71-9841-af46790cc859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:32 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e501a188-d927-4b82-a662-4f5b9d49eb7a tempest-AttachVolumeShelveTestJSON-34116855 None] Created volume successfully. Jun 11 05:12:33 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 1073741824" returned: 0 in 1.155s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:33 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 Jun 11 05:12:33 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:34 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9" returned: 0 in 1.271s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:34 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] <== create_volume: return (2483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:12:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.487s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9d3cd5-1b3a-474b-a56e-2db468790220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f038f6-084b-4478-9e96-e1559a477ec9', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af3e85d-a4de-4060-9c8e-f9a4f7f91550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:34 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Volume volume-15f038f6-084b-4478-9e96-e1559a477ec9 (15f038f6-084b-4478-9e96-e1559a477ec9): created successfully Jun 11 05:12:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af3e85d-a4de-4060-9c8e-f9a4f7f91550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Flow 'volume_create_manager' (6d92905a-eacc-49a9-898d-36b2dd5d2e8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:35 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-6e54d827-170d-4561-ac48-13a75076d996 tempest-GroupSnapshotsTest-62029582 None] Created volume successfully. Jun 11 05:12:35 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] GroupSnapshot d2d88997-9d8b-4bb4-afd8-43c8935e15ca: creating. Jun 11 05:12:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] Group snapshot d2d88997-9d8b-4bb4-afd8-43c8935e15ca: creating. {{(pid=92308) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 11 05:12:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] Creating offline snapshot c8564827-437a-4ede-add2-231273860ba9 of volume 15f038f6-084b-4478-9e96-e1559a477ec9 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:12:35 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5004ba7-f97b-4114-aecb-6e9cb32efb42]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:35 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 Jun 11 05:12:35 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:36 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9" returned: 0 in 0.921s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:36 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 1G Jun 11 05:12:36 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 1G" returned: 0 in 1.095s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15f038f6-084b-4478-9e96-e1559a477ec9 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:37 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:37 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15f038f6-084b-4478-9e96-e1559a477ec9 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 Jun 11 05:12:37 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:38 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15f038f6-084b-4478-9e96-e1559a477ec9 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9" returned: 0 in 0.883s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:38 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:12:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:38 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 Jun 11 05:12:38 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:39 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9" returned: 0 in 0.722s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:39 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.info Jun 11 05:12:39 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:39 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.info" returned: 0 in 0.712s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:39 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.info is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:12:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:39 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.info Jun 11 05:12:39 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:40 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.info" returned: 0 in 0.814s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.270s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:40 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-37c95efd-a97f-4321-8bb5-2f88cd0442c4 tempest-GroupSnapshotsTest-62029582 None] group_snapshot d2d88997-9d8b-4bb4-afd8-43c8935e15ca: created successfully Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-c8564827-437a-4ede-add2-231273860ba9-c4af1ee4-8581-4194-9e58-e951b90e2584" by "_create_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c8564827-437a-4ede-add2-231273860ba9-c4af1ee4-8581-4194-9e58-e951b90e2584" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Creating volume c4af1ee4-8581-4194-9e58-e951b90e2584 from snapshot c8564827-437a-4ede-add2-231273860ba9 {{(pid=92308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-c4af1ee4-8581-4194-9e58-e951b90e2584" by "_copy_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c4af1ee4-8581-4194-9e58-e951b90e2584" acquired by "_copy_volume_from_snapshot" :: waited 0.063s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] snapshot: c8564827-437a-4ede-add2-231273860ba9, volume: c4af1ee4-8581-4194-9e58-e951b90e2584, {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d806a6-6ca0-4937-ac26-ec5befe6d3f2]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:44 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 Jun 11 05:12:44 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:45 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9" returned: 0 in 1.463s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15f038f6-084b-4478-9e96-e1559a477ec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:12:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] will copy from snapshot at /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 11 05:12:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Creating direct copy from snapshot {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 11 05:12:45 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8491b8a-c256-4424-b667-6264a61f1836]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:45 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 Jun 11 05:12:45 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:46 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9" returned: 0 in 0.853s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:46 devstack cinder-volume[92308]: DEBUG cinder.utils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Path /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584 not found in is_blk_device check {{(pid=92308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 11 05:12:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:46 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584 Jun 11 05:12:46 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:52 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584" returned: 0 in 6.205s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:52 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c2908f-53c6-4ebd-ac7a-25d1de6121b5]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:52 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 Jun 11 05:12:52 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:53 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9" returned: 0 in 1.027s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:53 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584 {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:12:53 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Converted 1024.00 MB image at 164.98 MB/s Jun 11 05:12:53 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584 is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:12:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:53 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584 Jun 11 05:12:53 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:53 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:INSERT=11,cinder:UPDATE=51,cinder:SELECT=39,cinder:DELETE=4 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:12:53 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=36,cinder:INSERT=2,cinder:UPDATE=23 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:12:54 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584" returned: 0 in 0.821s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c4af1ee4-8581-4194-9e58-e951b90e2584" released by "_copy_volume_from_snapshot" :: held 10.592s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c8564827-437a-4ede-add2-231273860ba9-c4af1ee4-8581-4194-9e58-e951b90e2584" released by "_create_volume_from_snapshot" :: held 10.690s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.735s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:54 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b17b4146-e7ae-407c-ae69-3c320ba40289 tempest-GroupSnapshotsTest-62029582 None] Create group from source-snapshot-d2d88997-9d8b-4bb4-afd8-43c8935e15ca completed successfully. Jun 11 05:12:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-908ded14-b1ef-4e95-951c-41f8d224db2d req-33746e0f-d108-4b3a-817b-90d8fc0687ce tempest-AttachVolumeShelveTestJSON-34116855 None] No connector for attachment 94a3b5a3-2d88-456c-a5b8-c85bc473062c; skipping storage backend terminate_connection call. {{(pid=92308) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 11 05:12:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-908ded14-b1ef-4e95-951c-41f8d224db2d req-33746e0f-d108-4b3a-817b-90d8fc0687ce tempest-AttachVolumeShelveTestJSON-34116855 None] Deleting attachment 94a3b5a3-2d88-456c-a5b8-c85bc473062c. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:12:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-c4af1ee4-8581-4194-9e58-e951b90e2584" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c4af1ee4-8581-4194-9e58-e951b90e2584" acquired by "delete_volume" :: waited 0.025s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:54 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[30377538-6213-42f8-a776-58c77112b464]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:55 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584 Jun 11 05:12:55 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:55 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584" returned: 0 in 0.896s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:55 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584 Jun 11 05:12:55 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Flow 'volume_create_manager' (b48965a1-f2f7-4af7-bbfd-463132399400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f559bd7a-5dea-402f-b29a-c7690f850c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f559bd7a-5dea-402f-b29a-c7690f850c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1692745837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac08755-b585-4d46-a6e0-089174f5bcbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c64b48f74d4f36ba4207e8be9e0189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:56Z,use_quota=True,user_id='20a1072c7fe8493ebf89b4adafef68cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93aafd6-9dd2-4bc6-9acf-e63ddded8881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93aafd6-9dd2-4bc6-9acf-e63ddded8881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4433939-1cdb-45bd-886e-f8e85c6be8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4433939-1cdb-45bd-886e-f8e85c6be8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ac08755-b585-4d46-a6e0-089174f5bcbb', 'volume_name': 'volume-2ac08755-b585-4d46-a6e0-089174f5bcbb', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036365b4-1d0f-453a-a956-68072f08bdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036365b4-1d0f-453a-a956-68072f08bdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e52d238-5455-49b7-a4ae-dc3293790f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:56 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Volume 2ac08755-b585-4d46-a6e0-089174f5bcbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ac08755-b585-4d46-a6e0-089174f5bcbb', 'volume_size': 1} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1692745837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac08755-b585-4d46-a6e0-089174f5bcbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c64b48f74d4f36ba4207e8be9e0189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:12:56Z,use_quota=True,user_id='20a1072c7fe8493ebf89b4adafef68cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Creating volume 2ac08755-b585-4d46-a6e0-089174f5bcbb {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:12:56 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2ac08755-b585-4d46-a6e0-089174f5bcbb 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:56 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2ac08755-b585-4d46-a6e0-089174f5bcbb 1073741824 Jun 11 05:12:56 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:56 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c4af1ee4-8581-4194-9e58-e951b90e2584" returned: 0 in 0.860s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c4af1ee4-8581-4194-9e58-e951b90e2584" released by "delete_volume" :: held 1.845s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Created reservations ['1541eeb6-2a21-408b-a213-9b481d28d893'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:12:56 devstack cinder-volume[92308]: WARNING cinder.quota [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1085573767 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1085573767, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:12:56 devstack cinder-volume[92308]: WARNING cinder.quota [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1085573767 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1085573767, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:12:56 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Created reservations ['d4dcf576-b9bc-4c2f-8119-01afdaf3be5b', 'a080152b-3805-46db-9e9a-b2def69f1db4', '253f5f68-a916-42e5-8a43-2216f1bab9b6', 'efd60926-a4da-41ee-997d-ef33111b1826'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:57 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:12:57 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:57 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] group_snapshot d2d88997-9d8b-4bb4-afd8-43c8935e15ca: deleting Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] group_snapshot d2d88997-9d8b-4bb4-afd8-43c8935e15ca: deleting {{(pid=92308) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-15f038f6-084b-4478-9e96-e1559a477ec9" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-15f038f6-084b-4478-9e96-e1559a477ec9" acquired by "delete_snapshot" :: waited 0.034s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-c8564827-437a-4ede-add2-231273860ba9" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c8564827-437a-4ede-add2-231273860ba9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Deleting offline snapshot c8564827-437a-4ede-add2-231273860ba9 of volume 15f038f6-084b-4478-9e96-e1559a477ec9 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] snapshot_file for this snap is: volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb30a0c7-cf46-4b69-8e3b-db9ac88ded89]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:57 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 Jun 11 05:12:57 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:57 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2ac08755-b585-4d46-a6e0-089174f5bcbb 1073741824" returned: 0 in 1.276s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:57 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2ac08755-b585-4d46-a6e0-089174f5bcbb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.840s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:57 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:12:57 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-d9de8440-d158-4e9d-8954-a113d8c66136 tempest-GroupSnapshotsTest-62029582 None] Delete group completed successfully. Jun 11 05:12:57 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2ac08755-b585-4d46-a6e0-089174f5bcbb Jun 11 05:12:57 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:58 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9" returned: 0 in 0.827s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15f038f6-084b-4478-9e96-e1559a477ec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:12:58 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a492d1e-6314-4543-a45f-cb08dfa110f2]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:12:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:58 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 Jun 11 05:12:58 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:58 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2ac08755-b585-4d46-a6e0-089174f5bcbb" returned: 0 in 0.721s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:12:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:12:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e52d238-5455-49b7-a4ae-dc3293790f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ac08755-b585-4d46-a6e0-089174f5bcbb', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90552d01-160d-401a-b284-b638a455e5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:12:58 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Volume volume-2ac08755-b585-4d46-a6e0-089174f5bcbb (2ac08755-b585-4d46-a6e0-089174f5bcbb): created successfully Jun 11 05:12:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90552d01-160d-401a-b284-b638a455e5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:12:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Flow 'volume_create_manager' (b48965a1-f2f7-4af7-bbfd-463132399400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:12:58 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2affe684-249c-4396-82f5-f0264c2343a7 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Created volume successfully. Jun 11 05:12:59 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9" returned: 0 in 0.711s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:59 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 Jun 11 05:12:59 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:12:59 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-44f15ef5-a295-495a-9fc4-c77821441a62 req-ceb15289-42a6-47a0-ae81-b9467917c361 tempest-ServerActionsTestOtherA-987815009 None] Terminate volume connection completed successfully. Jun 11 05:12:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-44f15ef5-a295-495a-9fc4-c77821441a62 req-ceb15289-42a6-47a0-ae81-b9467917c361 tempest-ServerActionsTestOtherA-987815009 None] Deleting attachment d78be6e7-2059-4b98-91f1-c0f4a1b8de91. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:12:59 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Jun 11 05:12:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9" returned: 0 in 0.765s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:12:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:12:59 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9 Jun 11 05:12:59 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:00 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9.c8564827-437a-4ede-add2-231273860ba9" returned: 0 in 0.659s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c8564827-437a-4ede-add2-231273860ba9" released by "_delete_snapshot" :: held 3.107s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-15f038f6-084b-4478-9e96-e1559a477ec9" released by "delete_snapshot" :: held 3.137s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:00 devstack cinder-volume[92308]: WARNING cinder.quota [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1085573767 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1085573767, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:13:00 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] Created reservations ['1d61986a-1788-4d3b-8991-36411e0c732a', '38814696-5d33-44ef-a4a9-6bf39c5d9bc9', 'dfec7ad2-2212-4434-9445-7042817812b9', 'aabc7a5d-1825-434a-95dd-646753fa0363'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:00 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3db43aca-32eb-4dcd-9158-12de1fcefa62 tempest-GroupSnapshotsTest-62029582 None] group_snapshot d2d88997-9d8b-4bb4-afd8-43c8935e15ca: deleted successfully Jun 11 05:13:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Acquiring lock "cinder-2ac08755-b585-4d46-a6e0-089174f5bcbb-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Lock "cinder-2ac08755-b585-4d46-a6e0-089174f5bcbb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Acquiring lock "cinder-quobyte-2ac08755-b585-4d46-a6e0-089174f5bcbb" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Lock "cinder-quobyte-2ac08755-b585-4d46-a6e0-089174f5bcbb" acquired by "delete_volume" :: waited 0.017s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[232304fb-6772-4860-8812-dc0ecbfa1f06]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2ac08755-b585-4d46-a6e0-089174f5bcbb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-15f038f6-084b-4478-9e96-e1559a477ec9" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-15f038f6-084b-4478-9e96-e1559a477ec9" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:00 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2ac08755-b585-4d46-a6e0-089174f5bcbb Jun 11 05:13:00 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:01 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd15b834-9b9b-493b-9a3a-4b68a3786ddb]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:01 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 Jun 11 05:13:01 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:01 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2ac08755-b585-4d46-a6e0-089174f5bcbb" returned: 0 in 0.851s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2ac08755-b585-4d46-a6e0-089174f5bcbb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:01 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2ac08755-b585-4d46-a6e0-089174f5bcbb Jun 11 05:13:01 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:01 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9" returned: 0 in 0.831s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:01 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9 Jun 11 05:13:01 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:02 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2ac08755-b585-4d46-a6e0-089174f5bcbb" returned: 0 in 0.745s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Lock "cinder-quobyte-2ac08755-b585-4d46-a6e0-089174f5bcbb" released by "delete_volume" :: held 1.644s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:02 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-15f038f6-084b-4478-9e96-e1559a477ec9" returned: 0 in 0.711s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:02 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Created reservations ['5233d74d-7101-458f-8f2b-684520bba8d6', '83b7f4c5-4440-4584-912d-ef4277d5081d', '3580d72f-34c2-40dc-91ba-de22d0953954', 'd80bb79e-37ae-4525-b9de-794c53af40e0'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-15f038f6-084b-4478-9e96-e1559a477ec9" released by "delete_volume" :: held 1.698s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:13:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:13:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:02 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Created reservations ['e335053e-f2e9-49ec-919b-8ef6d7cde89f'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:02 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:13:02 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:02 devstack cinder-volume[92308]: WARNING cinder.db.sqlalchemy.api [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1085573767'] Jun 11 05:13:02 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Created reservations ['f255c89e-f535-44fd-8523-14505debd199', '41bec45c-1a0d-4269-8f2e-380dbe6691e9', '2fc2be9e-f22c-4fb3-a237-4f7ca0b1d78b', 'a0076b79-5ec9-4f53-9eaf-1a1e2f3956dc'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:13:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:13:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:03 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:13:03 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:03 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-13ae1dfd-ee27-4f76-b9ab-9086a01f661d tempest-GroupSnapshotsTest-62029582 None] Group tempest-GroupSnapshotsTest-Group-535662545: creating Jun 11 05:13:03 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-13ae1dfd-ee27-4f76-b9ab-9086a01f661d tempest-GroupSnapshotsTest-62029582 None] Group tempest-GroupSnapshotsTest-Group-535662545: created successfully Jun 11 05:13:03 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.185s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:03 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:13:03 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Deleted volume successfully. Jun 11 05:13:03 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-13ae1dfd-ee27-4f76-b9ab-9086a01f661d tempest-GroupSnapshotsTest-62029582 None] Create group completed successfully. Jun 11 05:13:03 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-05cb1619-5004-493f-a227-99f6e4a332a6 tempest-VolumeQuotasNegativeTestJSON-1663668240 None] Lock "cinder-2ac08755-b585-4d46-a6e0-089174f5bcbb-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:04 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.051s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:04 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:13:04 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b4cf01e3-7868-4424-84d2-293433a0f524 tempest-GroupSnapshotsTest-62029582 None] Delete group completed successfully. Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Flow 'volume_create_manager' (3b3adc40-370f-47dd-a704-8b3f49fc89cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221b7480-7cec-447c-914a-e39ac0e3c493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221b7480-7cec-447c-914a-e39ac0e3c493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-611180162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f93ef50d-807f-4c3b-a054-3a94d34b31cb,host='devstack@QuobyteHD#QuobyteHD',id=c68b1e75-d601-452f-8855-d1230e220aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a434ca7ca16f4e64a6e606047ee70c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:13:06Z,use_quota=True,user_id='8940707c6a894afc90e79b189d0d1b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ebcd477-9fb2-4b96-8e4b-d3f8790c52c8),volume_type_id=9ebcd477-9fb2-4b96-8e4b-d3f8790c52c8)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964994d4-8ac4-456e-b82e-7cb6a7f5928f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964994d4-8ac4-456e-b82e-7cb6a7f5928f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b06dd72-20e9-4997-af1a-35ef5f2f5679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b06dd72-20e9-4997-af1a-35ef5f2f5679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c68b1e75-d601-452f-8855-d1230e220aae', 'volume_name': 'volume-c68b1e75-d601-452f-8855-d1230e220aae', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8dd9dd4-2499-42cf-b900-1ea04033b231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8dd9dd4-2499-42cf-b900-1ea04033b231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb3e783-d40f-4487-9d3d-c6bca1dc6c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:05 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Volume c68b1e75-d601-452f-8855-d1230e220aae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c68b1e75-d601-452f-8855-d1230e220aae', 'volume_size': 1} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f93ef50d-807f-4c3b-a054-3a94d34b31cb,created_at=2026-06-11T03:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-611180162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f93ef50d-807f-4c3b-a054-3a94d34b31cb,host='devstack@QuobyteHD#QuobyteHD',id=c68b1e75-d601-452f-8855-d1230e220aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a434ca7ca16f4e64a6e606047ee70c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:13:06Z,use_quota=True,user_id='8940707c6a894afc90e79b189d0d1b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ebcd477-9fb2-4b96-8e4b-d3f8790c52c8),volume_type_id=9ebcd477-9fb2-4b96-8e4b-d3f8790c52c8)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Creating volume c68b1e75-d601-452f-8855-d1230e220aae {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:13:05 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:13:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:05 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae 1073741824 Jun 11 05:13:05 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:06 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae 1073741824" returned: 0 in 1.047s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:07 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae Jun 11 05:13:07 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:07 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae" returned: 0 in 0.819s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:13:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb3e783-d40f-4487-9d3d-c6bca1dc6c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68b1e75-d601-452f-8855-d1230e220aae', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a88d97-0827-4732-aeab-024654eb77b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:07 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Volume volume-c68b1e75-d601-452f-8855-d1230e220aae (c68b1e75-d601-452f-8855-d1230e220aae): created successfully Jun 11 05:13:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a88d97-0827-4732-aeab-024654eb77b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Flow 'volume_create_manager' (3b3adc40-370f-47dd-a704-8b3f49fc89cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:13:07 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-952fd9b4-f44f-496c-9ed7-758eeb689efd tempest-GroupSnapshotsTest-62029582 None] Created volume successfully. Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Flow 'volume_create_manager' (528d39c6-6cf5-46cb-abe5-1fab497d47d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e428d548-7461-492d-87fa-512327eaf388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e428d548-7461-492d-87fa-512327eaf388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-460922299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f93ef50d-807f-4c3b-a054-3a94d34b31cb,host='devstack@QuobyteHD#QuobyteHD',id=70223ba1-4694-438a-9320-b12190b67738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a434ca7ca16f4e64a6e606047ee70c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:13:08Z,use_quota=True,user_id='8940707c6a894afc90e79b189d0d1b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ebcd477-9fb2-4b96-8e4b-d3f8790c52c8),volume_type_id=9ebcd477-9fb2-4b96-8e4b-d3f8790c52c8)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c40a72b-b4e3-4165-8941-490dfbdba112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c40a72b-b4e3-4165-8941-490dfbdba112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f58d6ca-e80b-4051-9806-3066b5ee2223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f58d6ca-e80b-4051-9806-3066b5ee2223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70223ba1-4694-438a-9320-b12190b67738', 'volume_name': 'volume-70223ba1-4694-438a-9320-b12190b67738', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186e9161-e0fc-4f63-9a24-ec687019542e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186e9161-e0fc-4f63-9a24-ec687019542e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab9ddf2-98a6-4f9c-aa04-36a4f06dccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:08 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Volume 70223ba1-4694-438a-9320-b12190b67738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70223ba1-4694-438a-9320-b12190b67738', 'volume_size': 1} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f93ef50d-807f-4c3b-a054-3a94d34b31cb,created_at=2026-06-11T03:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-460922299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f93ef50d-807f-4c3b-a054-3a94d34b31cb,host='devstack@QuobyteHD#QuobyteHD',id=70223ba1-4694-438a-9320-b12190b67738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a434ca7ca16f4e64a6e606047ee70c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:13:08Z,use_quota=True,user_id='8940707c6a894afc90e79b189d0d1b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ebcd477-9fb2-4b96-8e4b-d3f8790c52c8),volume_type_id=9ebcd477-9fb2-4b96-8e4b-d3f8790c52c8)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Creating volume 70223ba1-4694-438a-9320-b12190b67738 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:13:08 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:13:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:08 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738 1073741824 Jun 11 05:13:08 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:09 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738 1073741824" returned: 0 in 1.008s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:09 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738 Jun 11 05:13:09 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:10 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738" returned: 0 in 0.809s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab9ddf2-98a6-4f9c-aa04-36a4f06dccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70223ba1-4694-438a-9320-b12190b67738', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400d4cb0-aefe-4068-9b20-4854c76ed35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:10 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Volume volume-70223ba1-4694-438a-9320-b12190b67738 (70223ba1-4694-438a-9320-b12190b67738): created successfully Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400d4cb0-aefe-4068-9b20-4854c76ed35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Flow 'volume_create_manager' (528d39c6-6cf5-46cb-abe5-1fab497d47d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Flow 'volume_create_manager' (5cd003c9-5a0e-4417-a5dd-24debe6bf33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6d9f25-0235-4ae4-b67c-1118084cd5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:10 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-854d2d68-d0cb-4609-8bb0-80d414a781e7 tempest-GroupSnapshotsTest-62029582 None] Created volume successfully. Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6d9f25-0235-4ae4-b67c-1118084cd5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-393231232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756925ff-f4a7-4601-a42f-b0a40977f307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5112bb7d1eae4cdd98fb9a6d132d8369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:13:10Z,use_quota=True,user_id='7aaf41e94ce04d3f91cdd61a7bb31db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd2bdce-76cf-4fbb-803f-bb1b787e9d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd2bdce-76cf-4fbb-803f-bb1b787e9d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4bcf97-5004-4e0e-b75d-7f7fa232c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4bcf97-5004-4e0e-b75d-7f7fa232c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '756925ff-f4a7-4601-a42f-b0a40977f307', 'volume_name': 'volume-756925ff-f4a7-4601-a42f-b0a40977f307', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49666cae-bb8c-48d4-8685-07df177cfdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49666cae-bb8c-48d4-8685-07df177cfdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa617c4-551b-4518-a9f3-7b7869f82d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:10 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Volume 756925ff-f4a7-4601-a42f-b0a40977f307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-756925ff-f4a7-4601-a42f-b0a40977f307', 'volume_size': 1} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-393231232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756925ff-f4a7-4601-a42f-b0a40977f307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5112bb7d1eae4cdd98fb9a6d132d8369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:13:10Z,use_quota=True,user_id='7aaf41e94ce04d3f91cdd61a7bb31db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Creating volume 756925ff-f4a7-4601-a42f-b0a40977f307 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:13:10 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:13:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:10 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307 1073741824 Jun 11 05:13:10 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:10 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0159a439-d2c2-43e2-b454-87677e0b7ebe tempest-GroupSnapshotsTest-62029582 None] Update group completed successfully. Jun 11 05:13:11 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Acquiring lock "cinder-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:11 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Lock "cinder-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:11 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Acquiring lock "cinder-quobyte-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:11 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Lock "cinder-quobyte-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04" acquired by "delete_volume" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:11 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[664feaf9-fc7e-450a-bac1-11c75447d8d3]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:11 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 Jun 11 05:13:11 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:11 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307 1073741824" returned: 0 in 0.911s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:11 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307 Jun 11 05:13:11 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:11 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04" returned: 0 in 0.690s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:11 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04 Jun 11 05:13:11 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:12 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-807f4c03-3eaa-4d25-8ce8-bebc68ec504c tempest-GroupSnapshotsTest-62029582 None] Update group completed successfully. Jun 11 05:13:12 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307" returned: 0 in 0.668s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa617c4-551b-4518-a9f3-7b7869f82d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756925ff-f4a7-4601-a42f-b0a40977f307', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096e5522-7a60-4ebd-a2db-0f584152d4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:12 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Volume volume-756925ff-f4a7-4601-a42f-b0a40977f307 (756925ff-f4a7-4601-a42f-b0a40977f307): created successfully Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096e5522-7a60-4ebd-a2db-0f584152d4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Flow 'volume_create_manager' (5cd003c9-5a0e-4417-a5dd-24debe6bf33f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:13:12 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-43e34fd1-b23d-4207-86ff-441226dceaf2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Created volume successfully. Jun 11 05:13:12 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04" returned: 0 in 0.747s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Lock "cinder-quobyte-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04" released by "delete_volume" :: held 1.487s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Created reservations ['258ca08c-6b2e-4d12-948c-960287afd4be', '8f3df545-f9c9-4c3d-8531-f8d26d045778', '094aba21-505a-4ef4-b89b-494925b27c98', '94582442-4340-41c8-b7d1-efdccfc65ad0'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:12 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:13:12 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Creating offline snapshot 5715e2d3-c010-4236-b956-483fc0f1929a of volume 756925ff-f4a7-4601-a42f-b0a40977f307 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[09290cc3-e2ec-471a-907f-850e29e7915d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:12 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307 Jun 11 05:13:12 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:13 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.619s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:13 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:13:13 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Deleted volume successfully. Jun 11 05:13:13 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fa0a633c-961d-4ca1-ae63-bb2cbe294add tempest-ServerActionsTestOtherA-987815009 None] Lock "cinder-1fb50911-8ae3-4c68-8a3c-987b7bd6fb04-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:13 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-40b1cc32-e95c-4799-8de8-005d73533d44 tempest-GroupSnapshotsTest-62029582 None] Update group completed successfully. Jun 11 05:13:13 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307" returned: 0 in 0.902s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:13 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a 1G Jun 11 05:13:13 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:14 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-51067c95-41ad-44b3-9799-6a9a7bc881bc tempest-GroupSnapshotsTest-62029582 None] Update group completed successfully. Jun 11 05:13:15 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a 1G" returned: 0 in 1.304s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-756925ff-f4a7-4601-a42f-b0a40977f307 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:15 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-756925ff-f4a7-4601-a42f-b0a40977f307 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a Jun 11 05:13:15 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:16 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-756925ff-f4a7-4601-a42f-b0a40977f307 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a" returned: 0 in 1.016s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:16 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a is being set with open permissions: ugo+rw Jun 11 05:13:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:16 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a Jun 11 05:13:16 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:16 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] GroupSnapshot ce55ca1e-5575-41e8-beef-ac03c56e27d0: creating. Jun 11 05:13:16 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Group snapshot ce55ca1e-5575-41e8-beef-ac03c56e27d0: creating. {{(pid=92308) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 11 05:13:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:16 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a" returned: 0 in 0.847s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:17 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.info Jun 11 05:13:17 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:17 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.info" returned: 0 in 0.744s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:17 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.info is being set with open permissions: ugo+rw Jun 11 05:13:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:17 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.info Jun 11 05:13:17 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:18 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.info" returned: 0 in 0.610s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.563s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.905s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Creating offline snapshot c05d164e-972e-430d-a112-04261ec1c3e6 of volume 70223ba1-4694-438a-9320-b12190b67738 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:13:18 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c17e6308-45d5-42cd-8fe5-cc8469e89389 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Create snapshot completed successfully Jun 11 05:13:18 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc38ed5-da69-41aa-b762-547d052efe75]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:18 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738 Jun 11 05:13:18 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:19 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738" returned: 0 in 0.720s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:19 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 1G Jun 11 05:13:19 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Acquiring lock "cinder-5715e2d3-c010-4236-b956-483fc0f1929a-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "cinder-5715e2d3-c010-4236-b956-483fc0f1929a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Acquiring lock "cinder-quobyte-756925ff-f4a7-4601-a42f-b0a40977f307" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "cinder-quobyte-756925ff-f4a7-4601-a42f-b0a40977f307" acquired by "delete_snapshot" :: waited 0.037s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Acquiring lock "cinder-quobyte-5715e2d3-c010-4236-b956-483fc0f1929a" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "cinder-quobyte-5715e2d3-c010-4236-b956-483fc0f1929a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Deleting offline snapshot 5715e2d3-c010-4236-b956-483fc0f1929a of volume 756925ff-f4a7-4601-a42f-b0a40977f307 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] snapshot_file for this snap is: volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10075e1-8cdc-4f71-a135-c69010e6e142]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:19 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a Jun 11 05:13:19 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:19 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 1G" returned: 0 in 0.825s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70223ba1-4694-438a-9320-b12190b67738 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:20 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70223ba1-4694-438a-9320-b12190b67738 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 Jun 11 05:13:20 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:20 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a" returned: 0 in 0.824s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:20 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-756925ff-f4a7-4601-a42f-b0a40977f307(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:13:20 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[af169485-92b8-48ef-88aa-17c6389af3b8]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:20 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307 Jun 11 05:13:20 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:20 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70223ba1-4694-438a-9320-b12190b67738 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6" returned: 0 in 0.775s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:20 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:13:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:20 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 Jun 11 05:13:20 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:21 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307" returned: 0 in 0.726s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:21 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a Jun 11 05:13:21 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:21 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6" returned: 0 in 0.656s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:21 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.info Jun 11 05:13:21 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:22 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a" returned: 0 in 0.857s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:22 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.info" returned: 0 in 0.773s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:22 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.info is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:13:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:22 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a Jun 11 05:13:22 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:22 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.info Jun 11 05:13:22 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:22 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.info" returned: 0 in 0.724s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.562s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Creating offline snapshot e8370e60-7fb4-4f0b-843a-f0cbfb26f05e of volume c68b1e75-d601-452f-8855-d1230e220aae {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:13:22 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[812a7041-90d0-45a7-8737-61c8cba82155]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:23 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307.5715e2d3-c010-4236-b956-483fc0f1929a" returned: 0 in 0.816s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "cinder-quobyte-5715e2d3-c010-4236-b956-483fc0f1929a" released by "_delete_snapshot" :: held 3.366s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "cinder-quobyte-756925ff-f4a7-4601-a42f-b0a40977f307" released by "delete_snapshot" :: held 3.398s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:23 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae Jun 11 05:13:23 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:23 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Created reservations ['330d9046-580c-4dc7-91c7-b45437267077', '1ba7f781-3a04-451d-9420-5a2db008d9f4', '500d77d8-5524-44eb-ac6e-ecf6445862eb', 'bb74ee1a-f791-458e-8124-661fe134884f'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:23 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Delete snapshot completed successfully. Jun 11 05:13:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-260b4765-5f2d-4fac-8a1a-98341e60dd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "cinder-5715e2d3-c010-4236-b956-483fc0f1929a-delete_snapshot" released by "delete_snapshot" :: held 3.632s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:23 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae" returned: 0 in 0.864s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:23 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e 1G Jun 11 05:13:23 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Acquiring lock "cinder-756925ff-f4a7-4601-a42f-b0a40977f307-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "cinder-756925ff-f4a7-4601-a42f-b0a40977f307-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Acquiring lock "cinder-quobyte-756925ff-f4a7-4601-a42f-b0a40977f307" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "cinder-quobyte-756925ff-f4a7-4601-a42f-b0a40977f307" acquired by "delete_volume" :: waited 0.031s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:24 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1b9c2b-f93b-4946-987d-bf9adb8c8cdb]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:24 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307 Jun 11 05:13:24 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:24 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e 1G" returned: 0 in 0.907s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68b1e75-d601-452f-8855-d1230e220aae -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:24 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68b1e75-d601-452f-8855-d1230e220aae -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e Jun 11 05:13:24 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:25 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307" returned: 0 in 1.068s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:25 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307 Jun 11 05:13:25 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:25 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68b1e75-d601-452f-8855-d1230e220aae -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e" returned: 0 in 0.896s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:25 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:13:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:25 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e Jun 11 05:13:25 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:26 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-756925ff-f4a7-4601-a42f-b0a40977f307" returned: 0 in 0.853s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "cinder-quobyte-756925ff-f4a7-4601-a42f-b0a40977f307" released by "delete_volume" :: held 2.009s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:26 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Created reservations ['9f7ccb59-4fb8-4f03-a17f-3dae4a9b70dd', 'd3a0827f-5b02-4d48-9db4-f7b9da24592d', 'ea63a2a9-3649-49a3-92f4-bf4d5ae9d82a', 'cf7e97bf-7c60-4df7-b66d-3d92fe736dcc'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:13:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:13:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:26 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:13:26 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:26 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e" returned: 0 in 0.791s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:26 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.info Jun 11 05:13:26 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:27 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.info" returned: 0 in 0.754s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:27 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.info is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:13:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:27 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.875s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:27 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:13:27 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.info Jun 11 05:13:27 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:27 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Deleted volume successfully. Jun 11 05:13:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-79ac7255-9a6e-49c9-aa6a-32a4a42d79f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1814668494 None] Lock "cinder-756925ff-f4a7-4601-a42f-b0a40977f307-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:27 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.info" returned: 0 in 0.700s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.026s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:28 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5f6f8c6a-7904-4f19-b25c-35a453aaebba tempest-GroupSnapshotsTest-62029582 None] group_snapshot ce55ca1e-5575-41e8-beef-ac03c56e27d0: created successfully Jun 11 05:13:29 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] group_snapshot ce55ca1e-5575-41e8-beef-ac03c56e27d0: deleting Jun 11 05:13:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] group_snapshot ce55ca1e-5575-41e8-beef-ac03c56e27d0: deleting {{(pid=92308) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 11 05:13:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-70223ba1-4694-438a-9320-b12190b67738" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-70223ba1-4694-438a-9320-b12190b67738" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-c05d164e-972e-430d-a112-04261ec1c3e6" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c05d164e-972e-430d-a112-04261ec1c3e6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Deleting offline snapshot c05d164e-972e-430d-a112-04261ec1c3e6 of volume 70223ba1-4694-438a-9320-b12190b67738 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:13:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] snapshot_file for this snap is: volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:13:29 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5283558c-0632-4b21-9692-1ad498aa6179]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:29 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 Jun 11 05:13:29 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:30 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6" returned: 0 in 0.818s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70223ba1-4694-438a-9320-b12190b67738(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:13:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:13:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:13:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:13:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:30 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bb8d3b-9f9a-4ade-b64e-e4d96623ec28]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:30 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:13:30 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:30 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738 Jun 11 05:13:30 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:31 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738" returned: 0 in 0.839s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:31 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.871s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:13:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:13:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 8 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:13:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:13:31 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 Jun 11 05:13:31 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:31 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6" returned: 0 in 0.791s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:31 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6 Jun 11 05:13:31 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:32 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738.c05d164e-972e-430d-a112-04261ec1c3e6" returned: 0 in 0.603s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c05d164e-972e-430d-a112-04261ec1c3e6" released by "_delete_snapshot" :: held 3.208s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-70223ba1-4694-438a-9320-b12190b67738" released by "delete_snapshot" :: held 3.240s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-c68b1e75-d601-452f-8855-d1230e220aae" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c68b1e75-d601-452f-8855-d1230e220aae" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-e8370e60-7fb4-4f0b-843a-f0cbfb26f05e" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-e8370e60-7fb4-4f0b-843a-f0cbfb26f05e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Deleting offline snapshot e8370e60-7fb4-4f0b-843a-f0cbfb26f05e of volume c68b1e75-d601-452f-8855-d1230e220aae {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:13:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] snapshot_file for this snap is: volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:13:32 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0793bffd-f952-4f91-9765-64c39cf0974f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:32 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e Jun 11 05:13:32 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:33 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e" returned: 0 in 0.882s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c68b1e75-d601-452f-8855-d1230e220aae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:13:33 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9113af-cf20-4613-9042-21da0451b5af]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:33 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae Jun 11 05:13:33 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:34 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae" returned: 0 in 1.088s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:34 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e Jun 11 05:13:34 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:35 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e" returned: 0 in 0.781s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:35 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e Jun 11 05:13:35 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:36 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae.e8370e60-7fb4-4f0b-843a-f0cbfb26f05e" returned: 0 in 0.650s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-e8370e60-7fb4-4f0b-843a-f0cbfb26f05e" released by "_delete_snapshot" :: held 3.565s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c68b1e75-d601-452f-8855-d1230e220aae" released by "delete_snapshot" :: held 3.602s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:36 devstack cinder-volume[92308]: WARNING cinder.quota [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-3026946 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-3026946, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:13:36 devstack cinder-volume[92308]: WARNING cinder.quota [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-3026946 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-3026946, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:13:36 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Created reservations ['7a382531-f976-4886-9ec9-52126b439478', '2a804b91-1882-4c2a-b4aa-e3182208c8e4', '41547a94-3fc5-4214-8bf7-874ff3f5867a', 'cb8c2ff6-ff6a-4435-8ba0-b651df186e59'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:36 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] Created reservations ['cdc9c231-e3bf-4735-8256-ebebe163280c', '52bbabfa-645b-4a48-ab0e-2f5e2688cce7', '80ce6375-ff28-4b87-898a-ac83c859ea2f', '781904d8-acc6-4527-ad19-314ebed5bad3'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:36 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-699fa6a2-fe75-41a9-9ca9-203339a27ff0 tempest-GroupSnapshotsTest-62029582 None] group_snapshot ce55ca1e-5575-41e8-beef-ac03c56e27d0: deleted successfully Jun 11 05:13:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-70223ba1-4694-438a-9320-b12190b67738" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-70223ba1-4694-438a-9320-b12190b67738" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:37 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c9d2be-7416-4a44-a7a0-cad9a62d0cef]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:37 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738 Jun 11 05:13:37 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:38 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738" returned: 0 in 1.414s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:38 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738 Jun 11 05:13:38 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:39 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-70223ba1-4694-438a-9320-b12190b67738" returned: 0 in 1.245s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-70223ba1-4694-438a-9320-b12190b67738" released by "delete_volume" :: held 2.790s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-c68b1e75-d601-452f-8855-d1230e220aae" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c68b1e75-d601-452f-8855-d1230e220aae" acquired by "delete_volume" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:40 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b39103-7434-4e3a-a1d4-8a900558a926]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:40 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae Jun 11 05:13:40 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:41 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae" returned: 0 in 0.986s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:41 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae Jun 11 05:13:41 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:41 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c68b1e75-d601-452f-8855-d1230e220aae" returned: 0 in 0.653s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-c68b1e75-d601-452f-8855-d1230e220aae" released by "delete_volume" :: held 1.725s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:41 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Created reservations ['98a7b7a4-02bb-48b6-92c6-fdec850ba9b6'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:41 devstack cinder-volume[92308]: WARNING cinder.quota [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-3026946 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-3026946, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:13:41 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Created reservations ['cfcc16e0-1c43-4664-82e7-6b4a05833e5c', 'f6ec4214-894e-49ba-8e05-fb57c98d3960', 'ae7f7c59-5d3e-442e-9f28-abcf4ff36b1c', '00c8ec5e-1574-443a-9e55-782ad6c95c2f'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:42 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Created reservations ['858506bd-799d-4557-b464-84c817e8b945', '7aec1694-e61e-4a30-a3a5-5dde9b7fe1e2', '70f0e810-6d60-46d1-9504-8e3d7a260513', '2da9b878-2099-4f66-8448-c34d8f97fbe1'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:13:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:13:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:42 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:13:42 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:42 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.715s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:42 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:13:42 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a289ed9f-671a-4b2d-8c54-7efbf45a2980 tempest-GroupSnapshotsTest-62029582 None] Delete group completed successfully. Jun 11 05:13:43 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-70f10919-001d-44db-a741-51aca4f22112 tempest-GroupSnapshotsTest-62029582 None] Group tempest-GroupSnapshotsTest-Group-261927296: creating Jun 11 05:13:43 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-70f10919-001d-44db-a741-51aca4f22112 tempest-GroupSnapshotsTest-62029582 None] Group tempest-GroupSnapshotsTest-Group-261927296: created successfully Jun 11 05:13:43 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-70f10919-001d-44db-a741-51aca4f22112 tempest-GroupSnapshotsTest-62029582 None] Create group completed successfully. Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Flow 'volume_create_manager' (752b1cc9-9fb6-4790-afe1-cf9afe5177a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca573ca-2712-4a2d-9eeb-472e59132afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca573ca-2712-4a2d-9eeb-472e59132afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2067208911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6346313a-95ab-44a8-a1e8-7d550fc468c1,host='devstack@QuobyteHD#QuobyteHD',id=5efec5d3-df90-454f-8553-02e3ab15ab9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a434ca7ca16f4e64a6e606047ee70c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:13:45Z,use_quota=True,user_id='8940707c6a894afc90e79b189d0d1b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac9eebbf-995f-4c08-9fbe-c71b5ce17fcc),volume_type_id=ac9eebbf-995f-4c08-9fbe-c71b5ce17fcc)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcd0f85-3a4a-4be1-ba5d-1f80044da906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcd0f85-3a4a-4be1-ba5d-1f80044da906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978a9831-80b9-411c-9099-49b82b0ed40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978a9831-80b9-411c-9099-49b82b0ed40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5efec5d3-df90-454f-8553-02e3ab15ab9b', 'volume_name': 'volume-5efec5d3-df90-454f-8553-02e3ab15ab9b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbb77d0-b25f-455d-874a-a17df9f2c3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbb77d0-b25f-455d-874a-a17df9f2c3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72f4940-b6a8-4cd8-8fcb-a328f96dd16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:45 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Volume 5efec5d3-df90-454f-8553-02e3ab15ab9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5efec5d3-df90-454f-8553-02e3ab15ab9b', 'volume_size': 1} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6346313a-95ab-44a8-a1e8-7d550fc468c1,created_at=2026-06-11T03:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2067208911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6346313a-95ab-44a8-a1e8-7d550fc468c1,host='devstack@QuobyteHD#QuobyteHD',id=5efec5d3-df90-454f-8553-02e3ab15ab9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a434ca7ca16f4e64a6e606047ee70c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:13:45Z,use_quota=True,user_id='8940707c6a894afc90e79b189d0d1b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac9eebbf-995f-4c08-9fbe-c71b5ce17fcc),volume_type_id=ac9eebbf-995f-4c08-9fbe-c71b5ce17fcc)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Creating volume 5efec5d3-df90-454f-8553-02e3ab15ab9b {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:13:45 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:13:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:45 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b 1073741824 Jun 11 05:13:45 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:46 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b 1073741824" returned: 0 in 0.954s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:46 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b Jun 11 05:13:46 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:47 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b" returned: 0 in 0.783s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:13:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72f4940-b6a8-4cd8-8fcb-a328f96dd16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5efec5d3-df90-454f-8553-02e3ab15ab9b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec69603-9eae-4554-8d26-35f715ffddbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:13:47 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Volume volume-5efec5d3-df90-454f-8553-02e3ab15ab9b (5efec5d3-df90-454f-8553-02e3ab15ab9b): created successfully Jun 11 05:13:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec69603-9eae-4554-8d26-35f715ffddbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:13:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Flow 'volume_create_manager' (752b1cc9-9fb6-4790-afe1-cf9afe5177a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:13:47 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e0312915-4127-4714-b33f-7c05ee413bb3 tempest-GroupSnapshotsTest-62029582 None] Created volume successfully. Jun 11 05:13:47 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] GroupSnapshot 5425be0d-e0ec-4a12-90d3-ccc1959d3bf2: creating. Jun 11 05:13:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] Group snapshot 5425be0d-e0ec-4a12-90d3-ccc1959d3bf2: creating. {{(pid=92308) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 11 05:13:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] Creating offline snapshot ff67f510-eb56-4830-b2f2-72979b69ba15 of volume 5efec5d3-df90-454f-8553-02e3ab15ab9b {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:13:48 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c824d7de-0721-4488-885a-4a4801990840]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:48 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b Jun 11 05:13:48 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Acquiring lock "cinder-c9545a89-8fab-41dc-8e31-a073f710d695-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "cinder-c9545a89-8fab-41dc-8e31-a073f710d695-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Acquiring lock "cinder-quobyte-c9545a89-8fab-41dc-8e31-a073f710d695" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "cinder-quobyte-c9545a89-8fab-41dc-8e31-a073f710d695" acquired by "delete_volume" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:48 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[57389dba-ecbe-4420-ab0f-61df2555353a]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9545a89-8fab-41dc-8e31-a073f710d695 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:48 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9545a89-8fab-41dc-8e31-a073f710d695 Jun 11 05:13:48 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:48 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b" returned: 0 in 0.862s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:48 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 1G Jun 11 05:13:48 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:49 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9545a89-8fab-41dc-8e31-a073f710d695" returned: 0 in 0.846s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9545a89-8fab-41dc-8e31-a073f710d695 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:49 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9545a89-8fab-41dc-8e31-a073f710d695 Jun 11 05:13:49 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:49 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 1G" returned: 0 in 1.014s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5efec5d3-df90-454f-8553-02e3ab15ab9b -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:49 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5efec5d3-df90-454f-8553-02e3ab15ab9b -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 Jun 11 05:13:49 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:49 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9545a89-8fab-41dc-8e31-a073f710d695" returned: 0 in 0.753s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "cinder-quobyte-c9545a89-8fab-41dc-8e31-a073f710d695" released by "delete_volume" :: held 1.669s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:50 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Created reservations ['14a191c5-7208-4ff5-a39a-4dabef88194e', '34cb56b4-6ca5-4d9a-975b-8f91144834f1', 'ac7dbc42-e9a6-4dc4-a678-f28bafd3c221', '057d27cb-88e9-47ce-a4ed-495e52d11aa4'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:50 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:13:50 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:13:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:50 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:13:50 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Acquiring lock "cinder-708a40c5-a22d-4711-914d-14dd3ae84e3f-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "cinder-708a40c5-a22d-4711-914d-14dd3ae84e3f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Acquiring lock "cinder-quobyte-708a40c5-a22d-4711-914d-14dd3ae84e3f" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "cinder-quobyte-708a40c5-a22d-4711-914d-14dd3ae84e3f" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:51 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[679902f0-27c7-46af-abf8-b4b4071adef6]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:51 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f Jun 11 05:13:51 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:51 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.017s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:51 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:13:51 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Deleted volume successfully. Jun 11 05:13:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4d30b121-5617-4cf3-9216-426aa6ed1b87 tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "cinder-c9545a89-8fab-41dc-8e31-a073f710d695-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:51 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5efec5d3-df90-454f-8553-02e3ab15ab9b -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15" returned: 0 in 1.579s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:51 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:13:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:51 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 Jun 11 05:13:51 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:52 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f" returned: 0 in 1.208s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:52 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f Jun 11 05:13:52 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:52 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15" returned: 0 in 0.892s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:52 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.info Jun 11 05:13:52 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:53 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-708a40c5-a22d-4711-914d-14dd3ae84e3f" returned: 0 in 0.831s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "cinder-quobyte-708a40c5-a22d-4711-914d-14dd3ae84e3f" released by "delete_volume" :: held 2.120s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:53 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Created reservations ['eb127b36-41a8-4582-a5d5-725474b77f1f', '681b2e69-1f9c-4a41-8fa6-86b3d7194142', 'c87b5ed9-6efb-4a42-89b7-7ec1ed3dc84b', '87a42e9c-1825-4b89-9b0f-0da8f024f942'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:53 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.info" returned: 0 in 0.832s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:53 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:13:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:53 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.info Jun 11 05:13:53 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:13:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:13:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:13:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:13:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:53 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:13:53 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:54 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.767s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:13:54 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Deleted volume successfully. Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=141,cinder:SELECT=118,cinder:INSERT=28,cinder:DELETE=6 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-44d0eab0-5e6a-46a5-a1b3-59228e0f13c3 tempest-AttachVolumeShelveTestJSON-34116855 None] Lock "cinder-708a40c5-a22d-4711-914d-14dd3ae84e3f-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:54 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.info" returned: 0 in 0.967s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.272s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=122,cinder:SELECT=120,cinder:INSERT=36,cinder:DELETE=5 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:13:54 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b42accb4-993f-419b-b1f8-cad3295538a1 tempest-GroupSnapshotsTest-62029582 None] group_snapshot 5425be0d-e0ec-4a12-90d3-ccc1959d3bf2: created successfully Jun 11 05:13:54 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] group_snapshot 5425be0d-e0ec-4a12-90d3-ccc1959d3bf2: deleting Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] group_snapshot 5425be0d-e0ec-4a12-90d3-ccc1959d3bf2: deleting {{(pid=92308) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-5efec5d3-df90-454f-8553-02e3ab15ab9b" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-5efec5d3-df90-454f-8553-02e3ab15ab9b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-ff67f510-eb56-4830-b2f2-72979b69ba15" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-ff67f510-eb56-4830-b2f2-72979b69ba15" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Deleting offline snapshot ff67f510-eb56-4830-b2f2-72979b69ba15 of volume 5efec5d3-df90-454f-8553-02e3ab15ab9b {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] snapshot_file for this snap is: volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0668da6b-b054-4c3c-af4a-9440a6b2dcb1]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:54 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 Jun 11 05:13:54 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:55 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15" returned: 0 in 0.897s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5efec5d3-df90-454f-8553-02e3ab15ab9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:13:55 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8372a883-8847-408e-b8c4-6d3d05c1c0fa]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:55 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b Jun 11 05:13:55 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:56 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b" returned: 0 in 0.776s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:56 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 Jun 11 05:13:56 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:57 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15" returned: 0 in 0.849s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:57 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15 Jun 11 05:13:57 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:13:58 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jun 11 05:13:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b.ff67f510-eb56-4830-b2f2-72979b69ba15" returned: 0 in 0.671s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:13:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-ff67f510-eb56-4830-b2f2-72979b69ba15" released by "_delete_snapshot" :: held 3.334s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-5efec5d3-df90-454f-8553-02e3ab15ab9b" released by "delete_snapshot" :: held 3.370s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:13:58 devstack cinder-volume[92308]: WARNING cinder.quota [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-466410416 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-466410416, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:13:58 devstack cinder-volume[92308]: WARNING cinder.quota [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-466410416 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-466410416, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:13:58 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] Created reservations ['120a69d1-bd69-4218-bc2c-e731239affd4', '66771267-b5f2-426b-bdb7-d931069f540a', 'f86365b6-8b79-49a8-9b3c-3b25bfb97ade', '89c8d4fa-b9e7-475f-ade3-57ca117a8309'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:13:58 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-20d72eee-c162-40c1-88db-04df65d6fa0d tempest-GroupSnapshotsTest-62029582 None] group_snapshot 5425be0d-e0ec-4a12-90d3-ccc1959d3bf2: deleted successfully Jun 11 05:13:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "cinder-quobyte-5efec5d3-df90-454f-8553-02e3ab15ab9b" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:13:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-5efec5d3-df90-454f-8553-02e3ab15ab9b" acquired by "delete_volume" :: waited 0.026s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:13:59 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb80a75-7cb8-43ab-bf0e-f074beffcd8a]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:13:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:13:59 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b Jun 11 05:13:59 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:00 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b" returned: 0 in 0.829s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:00 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b Jun 11 05:14:00 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:00 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5efec5d3-df90-454f-8553-02e3ab15ab9b" returned: 0 in 0.683s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Lock "cinder-quobyte-5efec5d3-df90-454f-8553-02e3ab15ab9b" released by "delete_volume" :: held 1.606s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:14:01 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Created reservations ['f3e3adbf-35d2-4ab0-8d4e-a3a0d97955b8'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:14:01 devstack cinder-volume[92308]: WARNING cinder.quota [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-466410416 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-466410416, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:14:01 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Created reservations ['7bf27b06-12ff-40eb-9804-f1b6c127e203', 'dc94eb51-d7b2-46ad-bbf2-c13e21a50fef', '8446be11-7e5d-400b-a22e-711e392c083f', '89acf060-62ad-4565-91f1-bb27855c33e3'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:14:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:14:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:14:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:14:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:14:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:14:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:01 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:14:01 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.878s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:02 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:02 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:14:02 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-1fda69e8-eace-4c1b-99c0-60da3107d982 tempest-GroupSnapshotsTest-62029582 None] Delete group completed successfully. Jun 11 05:14:11 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=21,cinder:SELECT=20,cinder:INSERT=6 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:14:11 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=15,cinder:UPDATE=16,cinder:INSERT=3 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:14:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:14:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:14:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:14:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:14:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:14:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:14:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:30 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:14:30 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:31 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.258s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 8 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Flow 'volume_create_manager' (22521e14-247d-4b8c-b2d3-39e22204d5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517566b8-66cc-44e6-a014-62729babf1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517566b8-66cc-44e6-a014-62729babf1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1626281989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8af7fda-f6d8-4e70-8dc7-59e588116501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f69d0bd9f4e459b3738a96a0b3cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:14:32Z,use_quota=True,user_id='36dea7e1b2144e5ab5b5b85aaeb260dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f763a21e-81a3-4ae5-9c05-73acfab83b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f763a21e-81a3-4ae5-9c05-73acfab83b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671100ee-b514-4d98-b0ad-32288c5c995e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671100ee-b514-4d98-b0ad-32288c5c995e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8af7fda-f6d8-4e70-8dc7-59e588116501', 'volume_name': 'volume-d8af7fda-f6d8-4e70-8dc7-59e588116501', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228c9b57-ee97-4ce7-af3e-66f01843d824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228c9b57-ee97-4ce7-af3e-66f01843d824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654bf87a-b8c5-48f4-a004-52ea9546b657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:31 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Volume d8af7fda-f6d8-4e70-8dc7-59e588116501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8af7fda-f6d8-4e70-8dc7-59e588116501', 'volume_size': 1} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1626281989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8af7fda-f6d8-4e70-8dc7-59e588116501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f69d0bd9f4e459b3738a96a0b3cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:14:32Z,use_quota=True,user_id='36dea7e1b2144e5ab5b5b85aaeb260dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Creating volume d8af7fda-f6d8-4e70-8dc7-59e588116501 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:14:31 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:14:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8af7fda-f6d8-4e70-8dc7-59e588116501 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:32 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8af7fda-f6d8-4e70-8dc7-59e588116501 1073741824 Jun 11 05:14:32 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:33 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8af7fda-f6d8-4e70-8dc7-59e588116501 1073741824" returned: 0 in 1.363s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8af7fda-f6d8-4e70-8dc7-59e588116501 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:33 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8af7fda-f6d8-4e70-8dc7-59e588116501 Jun 11 05:14:33 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:34 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8af7fda-f6d8-4e70-8dc7-59e588116501" returned: 0 in 1.307s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:34 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] <== create_volume: return (2768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:14:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.777s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:14:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654bf87a-b8c5-48f4-a004-52ea9546b657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8af7fda-f6d8-4e70-8dc7-59e588116501', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd68fca-08ac-4d9b-abdd-73bb0a085884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:34 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Volume volume-d8af7fda-f6d8-4e70-8dc7-59e588116501 (d8af7fda-f6d8-4e70-8dc7-59e588116501): created successfully Jun 11 05:14:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd68fca-08ac-4d9b-abdd-73bb0a085884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Flow 'volume_create_manager' (22521e14-247d-4b8c-b2d3-39e22204d5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:14:34 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-7f99f5bd-14c1-4a36-958e-aa44daea3560 tempest-ServerRescueNegativeTestJSON-1305359677 None] Created volume successfully. Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Flow 'volume_create_manager' (2b315419-a069-4ce9-86ca-97c7ff2961af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25de9d9-a5e3-49c4-b024-d1c990493425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25de9d9-a5e3-49c4-b024-d1c990493425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1405933702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741f0121-e903-4f65-be66-a5912fd666de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3826c8915596448c8b3d1759a559f77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:14:40Z,use_quota=True,user_id='ddb73b85a50f4014889554b1aac18b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2672668c-e394-4bf8-a56a-cb8200064d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2672668c-e394-4bf8-a56a-cb8200064d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7edbdc3-8be0-47d8-b162-d256dcbbbe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7edbdc3-8be0-47d8-b162-d256dcbbbe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '741f0121-e903-4f65-be66-a5912fd666de', 'volume_name': 'volume-741f0121-e903-4f65-be66-a5912fd666de', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173143e6-c729-4763-a85d-d51da69215b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173143e6-c729-4763-a85d-d51da69215b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4581e55c-82e2-4f33-bd6b-8ead47ce7a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:39 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Volume 741f0121-e903-4f65-be66-a5912fd666de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-741f0121-e903-4f65-be66-a5912fd666de', 'volume_size': 1} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1405933702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741f0121-e903-4f65-be66-a5912fd666de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3826c8915596448c8b3d1759a559f77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:14:40Z,use_quota=True,user_id='ddb73b85a50f4014889554b1aac18b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Creating volume 741f0121-e903-4f65-be66-a5912fd666de {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:14:39 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:14:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-741f0121-e903-4f65-be66-a5912fd666de 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:39 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-741f0121-e903-4f65-be66-a5912fd666de 1073741824 Jun 11 05:14:39 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:42 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-741f0121-e903-4f65-be66-a5912fd666de 1073741824" returned: 0 in 2.668s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-741f0121-e903-4f65-be66-a5912fd666de {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:42 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-741f0121-e903-4f65-be66-a5912fd666de Jun 11 05:14:42 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:44 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-741f0121-e903-4f65-be66-a5912fd666de" returned: 0 in 1.491s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] <== create_volume: return (4274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.283s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4581e55c-82e2-4f33-bd6b-8ead47ce7a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741f0121-e903-4f65-be66-a5912fd666de', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957cc583-82bc-46a1-83cd-bc2a58e66c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:44 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Volume volume-741f0121-e903-4f65-be66-a5912fd666de (741f0121-e903-4f65-be66-a5912fd666de): created successfully Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957cc583-82bc-46a1-83cd-bc2a58e66c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Flow 'volume_create_manager' (2b315419-a069-4ce9-86ca-97c7ff2961af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:14:44 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3c90046a-0b04-4bef-b574-9926ec114f40 tempest-VolumesActionsTest-691641204 None] Created volume successfully. Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Flow 'volume_create_manager' (f2b11473-129d-492f-b9f0-d9ad395505ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae9de5a-d946-4a95-9d96-b497470a8361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae9de5a-d946-4a95-9d96-b497470a8361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1055834878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6750de62-3795-45d1-b228-b2a804caa793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f95ea60d100407b9c5c88a94ba478ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:14:44Z,use_quota=True,user_id='7892b547c13e4e1ea1a0340897b211fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430491cf-fc51-4ec8-bdf4-4ee7177c42a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430491cf-fc51-4ec8-bdf4-4ee7177c42a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3787606-9372-46ce-b42d-b911b279829d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3787606-9372-46ce-b42d-b911b279829d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6750de62-3795-45d1-b228-b2a804caa793', 'volume_name': 'volume-6750de62-3795-45d1-b228-b2a804caa793', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64170d8-84a1-4d7a-9ed1-7817d9723726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64170d8-84a1-4d7a-9ed1-7817d9723726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d35fda-50d9-4c57-bf2f-03839331c13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:44 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Volume 6750de62-3795-45d1-b228-b2a804caa793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6750de62-3795-45d1-b228-b2a804caa793', 'volume_size': 1} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1055834878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6750de62-3795-45d1-b228-b2a804caa793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f95ea60d100407b9c5c88a94ba478ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:14:44Z,use_quota=True,user_id='7892b547c13e4e1ea1a0340897b211fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Creating volume 6750de62-3795-45d1-b228-b2a804caa793 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:14:44 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:14:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6750de62-3795-45d1-b228-b2a804caa793 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:44 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6750de62-3795-45d1-b228-b2a804caa793 1073741824 Jun 11 05:14:44 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-dbec5fae-21d8-46a4-ac50-2f6154e1c4f4 tempest-VolumesActionsTest-691641204 None] Acquiring lock "cinder-741f0121-e903-4f65-be66-a5912fd666de" by "attach_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:14:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-dbec5fae-21d8-46a4-ac50-2f6154e1c4f4 tempest-VolumesActionsTest-691641204 None] Lock "cinder-741f0121-e903-4f65-be66-a5912fd666de" acquired by "attach_volume" :: waited 0.057s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:14:46 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-dbec5fae-21d8-46a4-ac50-2f6154e1c4f4 tempest-VolumesActionsTest-691641204 None] Attaching volume 741f0121-e903-4f65-be66-a5912fd666de to instance ff3db2b1-0ef5-43ba-9f1e-936d981c9982 at mountpoint /dev/vdb on host None. Jun 11 05:14:46 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-dbec5fae-21d8-46a4-ac50-2f6154e1c4f4 tempest-VolumesActionsTest-691641204 None] Attach volume completed successfully. Jun 11 05:14:46 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-dbec5fae-21d8-46a4-ac50-2f6154e1c4f4 tempest-VolumesActionsTest-691641204 None] Lock "cinder-741f0121-e903-4f65-be66-a5912fd666de" released by "attach_volume" :: held 0.309s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:14:46 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6750de62-3795-45d1-b228-b2a804caa793 1073741824" returned: 0 in 2.305s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6750de62-3795-45d1-b228-b2a804caa793 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:46 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6750de62-3795-45d1-b228-b2a804caa793 Jun 11 05:14:46 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:48 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-90cb8491-f6ac-46df-b2ac-f4bf66b5d564 tempest-VolumesActionsTest-817565191 None] Terminate volume connection completed successfully. Jun 11 05:14:48 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6750de62-3795-45d1-b228-b2a804caa793" returned: 0 in 1.727s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] <== create_volume: return (4143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:14:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.147s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:14:48 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d35fda-50d9-4c57-bf2f-03839331c13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6750de62-3795-45d1-b228-b2a804caa793', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:48 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e2bfcb-8bb3-4d3d-8ba0-3addb9b21423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:48 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Volume volume-6750de62-3795-45d1-b228-b2a804caa793 (6750de62-3795-45d1-b228-b2a804caa793): created successfully Jun 11 05:14:48 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e2bfcb-8bb3-4d3d-8ba0-3addb9b21423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:48 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Flow 'volume_create_manager' (f2b11473-129d-492f-b9f0-d9ad395505ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:14:48 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a0576f30-0bed-444e-b279-72834173e573 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Created volume successfully. Jun 11 05:14:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-90cb8491-f6ac-46df-b2ac-f4bf66b5d564 tempest-VolumesActionsTest-817565191 None] Acquiring lock "cinder-741f0121-e903-4f65-be66-a5912fd666de-detach_volume" by "detach_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:14:49 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-90cb8491-f6ac-46df-b2ac-f4bf66b5d564 tempest-VolumesActionsTest-817565191 None] Lock "cinder-741f0121-e903-4f65-be66-a5912fd666de-detach_volume" acquired by "detach_volume" :: waited 0.064s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:14:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-90cb8491-f6ac-46df-b2ac-f4bf66b5d564 tempest-VolumesActionsTest-817565191 None] Detaching volume 741f0121-e903-4f65-be66-a5912fd666de from instance ff3db2b1-0ef5-43ba-9f1e-936d981c9982. Jun 11 05:14:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-90cb8491-f6ac-46df-b2ac-f4bf66b5d564 tempest-VolumesActionsTest-817565191 None] Detach volume completed successfully. Jun 11 05:14:49 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-90cb8491-f6ac-46df-b2ac-f4bf66b5d564 tempest-VolumesActionsTest-817565191 None] Lock "cinder-741f0121-e903-4f65-be66-a5912fd666de-detach_volume" released by "detach_volume" :: held 0.179s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:14:49 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Acquiring lock "cinder-6750de62-3795-45d1-b228-b2a804caa793-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:14:49 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "cinder-6750de62-3795-45d1-b228-b2a804caa793-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:14:49 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Acquiring lock "cinder-quobyte-6750de62-3795-45d1-b228-b2a804caa793" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:14:49 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "cinder-quobyte-6750de62-3795-45d1-b228-b2a804caa793" acquired by "delete_volume" :: waited 0.055s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:14:49 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2ba16d-b568-4762-91cd-88183b1a90b5]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:14:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6750de62-3795-45d1-b228-b2a804caa793 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:49 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6750de62-3795-45d1-b228-b2a804caa793 Jun 11 05:14:49 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-59a13cbc-3ebf-4aff-a68c-dd623663d2bc tempest-VolumesActionsTest-691641204 None] Acquiring lock "cinder-741f0121-e903-4f65-be66-a5912fd666de-detach_volume" by "detach_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:14:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-59a13cbc-3ebf-4aff-a68c-dd623663d2bc tempest-VolumesActionsTest-691641204 None] Lock "cinder-741f0121-e903-4f65-be66-a5912fd666de-detach_volume" acquired by "detach_volume" :: waited 0.054s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:14:50 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-59a13cbc-3ebf-4aff-a68c-dd623663d2bc tempest-VolumesActionsTest-691641204 None] Volume detach called, but volume not attached. Jun 11 05:14:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-59a13cbc-3ebf-4aff-a68c-dd623663d2bc tempest-VolumesActionsTest-691641204 None] Lock "cinder-741f0121-e903-4f65-be66-a5912fd666de-detach_volume" released by "detach_volume" :: held 0.075s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:14:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6750de62-3795-45d1-b228-b2a804caa793" returned: 0 in 1.732s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:51 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6750de62-3795-45d1-b228-b2a804caa793 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:51 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6750de62-3795-45d1-b228-b2a804caa793 Jun 11 05:14:51 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Acquiring lock "cinder-741f0121-e903-4f65-be66-a5912fd666de-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:14:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Lock "cinder-741f0121-e903-4f65-be66-a5912fd666de-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:14:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Acquiring lock "cinder-quobyte-741f0121-e903-4f65-be66-a5912fd666de" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:14:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Lock "cinder-quobyte-741f0121-e903-4f65-be66-a5912fd666de" acquired by "delete_volume" :: waited 0.034s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:14:51 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe70839-e2af-4e19-8c52-955d8dd1f506]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:14:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-741f0121-e903-4f65-be66-a5912fd666de {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:52 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-741f0121-e903-4f65-be66-a5912fd666de Jun 11 05:14:52 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:53 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6750de62-3795-45d1-b228-b2a804caa793" returned: 0 in 1.932s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "cinder-quobyte-6750de62-3795-45d1-b228-b2a804caa793" released by "delete_volume" :: held 3.756s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:14:53 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Created reservations ['e174cd40-801e-471c-953b-de1afedaf41a', '18941da6-a931-46b2-af0a-f0295165897a', '9ee7691c-54ca-4948-8139-df5b2e8e99bb', '565e9e3f-b5db-4732-8532-2947c802575b'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:14:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:14:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:14:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:14:53 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:14:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:14:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-741f0121-e903-4f65-be66-a5912fd666de" returned: 0 in 1.821s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-741f0121-e903-4f65-be66-a5912fd666de {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:53 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:14:53 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:53 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-741f0121-e903-4f65-be66-a5912fd666de Jun 11 05:14:53 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:54 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-741f0121-e903-4f65-be66-a5912fd666de" returned: 0 in 1.331s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Lock "cinder-quobyte-741f0121-e903-4f65-be66-a5912fd666de" released by "delete_volume" :: held 3.287s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Created reservations ['0abdfbeb-ef76-4cf2-831f-c508dbc2aa8c', '138c305f-99bb-4c65-bf3d-d530b65430f0', '477613f8-417b-4555-8477-db870b8f1ccc', 'e0f07173-6d9f-4399-a793-2fddabc4d28c'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:14:55 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.675s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:14:55 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Deleted volume successfully. Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9f89f5e4-d48d-49b7-a97c-297ba0102c8a tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "cinder-6750de62-3795-45d1-b228-b2a804caa793-delete_volume" released by "delete_volume" :: held 5.913s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:55 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:14:55 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Flow 'volume_create_manager' (d3b85ab7-fcf5-4872-9bbd-12aaecb9d678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5a1ef4-bbac-4f6a-af02-4d42fb55db28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5a1ef4-bbac-4f6a-af02-4d42fb55db28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-864330987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff52929-96b5-4737-8078-062e7826f398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f95ea60d100407b9c5c88a94ba478ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:14:55Z,use_quota=True,user_id='7892b547c13e4e1ea1a0340897b211fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603ae21b-d9cb-4cb7-aa01-2c2bbf24a15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603ae21b-d9cb-4cb7-aa01-2c2bbf24a15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3725a72e-3476-4297-a514-f30395a9df3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3725a72e-3476-4297-a514-f30395a9df3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff52929-96b5-4737-8078-062e7826f398', 'volume_name': 'volume-6ff52929-96b5-4737-8078-062e7826f398', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d69de2-9d5b-4617-b1e9-32e215b54f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d69de2-9d5b-4617-b1e9-32e215b54f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d13064-afef-41a5-9671-d1641d961cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:55 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Volume 6ff52929-96b5-4737-8078-062e7826f398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff52929-96b5-4737-8078-062e7826f398', 'volume_size': 1} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-864330987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff52929-96b5-4737-8078-062e7826f398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f95ea60d100407b9c5c88a94ba478ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:14:55Z,use_quota=True,user_id='7892b547c13e4e1ea1a0340897b211fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Creating volume 6ff52929-96b5-4737-8078-062e7826f398 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:14:55 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:14:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff52929-96b5-4737-8078-062e7826f398 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:55 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff52929-96b5-4737-8078-062e7826f398 1073741824 Jun 11 05:14:55 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:56 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.098s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:56 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:14:56 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Deleted volume successfully. Jun 11 05:14:56 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-feaddf62-3766-4be9-91ec-67fac98adb85 tempest-VolumesActionsTest-691641204 None] Lock "cinder-741f0121-e903-4f65-be66-a5912fd666de-delete_volume" released by "delete_volume" :: held 5.046s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:14:57 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff52929-96b5-4737-8078-062e7826f398 1073741824" returned: 0 in 1.769s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff52929-96b5-4737-8078-062e7826f398 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:14:57 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff52929-96b5-4737-8078-062e7826f398 Jun 11 05:14:57 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:14:58 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Jun 11 05:14:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff52929-96b5-4737-8078-062e7826f398" returned: 0 in 1.511s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:14:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] <== create_volume: return (3389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:14:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.396s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:14:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d13064-afef-41a5-9671-d1641d961cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff52929-96b5-4737-8078-062e7826f398', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1bb5a7-b9e5-4193-a735-1447fa70d6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:14:59 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Volume volume-6ff52929-96b5-4737-8078-062e7826f398 (6ff52929-96b5-4737-8078-062e7826f398): created successfully Jun 11 05:14:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1bb5a7-b9e5-4193-a735-1447fa70d6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:14:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Flow 'volume_create_manager' (d3b85ab7-fcf5-4872-9bbd-12aaecb9d678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:14:59 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-295c2448-a143-42e4-a150-99f1e094a9e8 tempest-VolumeQuotasAdminTestJSON-1608531981 None] Created volume successfully. Jun 11 05:15:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Acquiring lock "cinder-d8af7fda-f6d8-4e70-8dc7-59e588116501-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Lock "cinder-d8af7fda-f6d8-4e70-8dc7-59e588116501-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Acquiring lock "cinder-quobyte-d8af7fda-f6d8-4e70-8dc7-59e588116501" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Lock "cinder-quobyte-d8af7fda-f6d8-4e70-8dc7-59e588116501" acquired by "delete_volume" :: waited 0.027s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3616b84-936e-47fc-b0ce-48664c4db253]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8af7fda-f6d8-4e70-8dc7-59e588116501 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:00 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8af7fda-f6d8-4e70-8dc7-59e588116501 Jun 11 05:15:00 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:00 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-bb3020b3-adc9-4a42-ba01-3e6c3ae1dec9 tempest-VolumeQuotasAdminTestJSON-1809177939 None] Transfer volume completed successfully. Jun 11 05:15:01 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8af7fda-f6d8-4e70-8dc7-59e588116501" returned: 0 in 0.964s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8af7fda-f6d8-4e70-8dc7-59e588116501 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:01 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8af7fda-f6d8-4e70-8dc7-59e588116501 Jun 11 05:15:01 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:02 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8af7fda-f6d8-4e70-8dc7-59e588116501" returned: 0 in 0.934s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Acquiring lock "cinder-6ff52929-96b5-4737-8078-062e7826f398-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Lock "cinder-quobyte-d8af7fda-f6d8-4e70-8dc7-59e588116501" released by "delete_volume" :: held 1.966s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Lock "cinder-6ff52929-96b5-4737-8078-062e7826f398-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Acquiring lock "cinder-quobyte-6ff52929-96b5-4737-8078-062e7826f398" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Lock "cinder-quobyte-6ff52929-96b5-4737-8078-062e7826f398" acquired by "delete_volume" :: waited 0.029s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Created reservations ['7644b986-00fb-4e6a-a102-9ba708137f3d', '3122d21f-509e-4dca-bfa5-15636c98c489', '982ee8f7-12be-4614-b8f8-f1bd3a3e00cf', 'c4ddafd3-4e8d-462d-82f5-d3347661886d'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfc5a3b-a2ac-46c6-8092-dc0cc6286b72]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff52929-96b5-4737-8078-062e7826f398 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:02 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:15:02 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:02 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff52929-96b5-4737-8078-062e7826f398 Jun 11 05:15:02 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:03 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.796s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:03 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:15:03 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Deleted volume successfully. Jun 11 05:15:03 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f2fb8393-a788-483c-8c53-96054f1f3812 tempest-ServerRescueNegativeTestJSON-1305359677 None] Lock "cinder-d8af7fda-f6d8-4e70-8dc7-59e588116501-delete_volume" released by "delete_volume" :: held 3.184s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:03 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff52929-96b5-4737-8078-062e7826f398" returned: 0 in 1.068s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff52929-96b5-4737-8078-062e7826f398 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:03 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff52929-96b5-4737-8078-062e7826f398 Jun 11 05:15:03 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:04 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6ff52929-96b5-4737-8078-062e7826f398" returned: 0 in 0.766s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Lock "cinder-quobyte-6ff52929-96b5-4737-8078-062e7826f398" released by "delete_volume" :: held 1.905s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Created reservations ['c0e91fa9-4489-4617-a850-a7101e48480b', '5de887f2-e483-4a0e-aeb3-652366ae3d5b', '75f9572f-f5de-44b8-ba91-1474365432ac', '56c02a74-196a-4a1c-93e1-4cd7b812dd00'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:04 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:15:04 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Flow 'volume_create_manager' (f8e10208-b189-43dc-8cde-66ee474830ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd9b78a-9e00-4cb2-8ae1-174704a65257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd9b78a-9e00-4cb2-8ae1-174704a65257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1849215737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6832d0d2-50f9-4b76-b76a-0be23a6a4dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3826c8915596448c8b3d1759a559f77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:05Z,use_quota=True,user_id='ddb73b85a50f4014889554b1aac18b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afda478-f4c1-4355-b389-a5a975d053a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afda478-f4c1-4355-b389-a5a975d053a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4414a8e7-a997-4224-8842-4d32ef4e88e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4414a8e7-a997-4224-8842-4d32ef4e88e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6832d0d2-50f9-4b76-b76a-0be23a6a4dce', 'volume_name': 'volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a52bae5-2794-4336-8913-5b97530cfab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a52bae5-2794-4336-8913-5b97530cfab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6093eda5-3c3a-41c7-9d17-4a90f28f5e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:04 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Volume 6832d0d2-50f9-4b76-b76a-0be23a6a4dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce', 'volume_size': 1} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1849215737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6832d0d2-50f9-4b76-b76a-0be23a6a4dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3826c8915596448c8b3d1759a559f77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:05Z,use_quota=True,user_id='ddb73b85a50f4014889554b1aac18b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Creating volume 6832d0d2-50f9-4b76-b76a-0be23a6a4dce {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:15:04 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:15:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:05 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce 1073741824 Jun 11 05:15:05 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:05 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.483s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:05 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:15:05 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Deleted volume successfully. Jun 11 05:15:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9d2bb23a-e319-407b-a2e8-090e9f58b8a4 tempest-VolumeQuotasAdminTestJSON-1309527975 None] Lock "cinder-6ff52929-96b5-4737-8078-062e7826f398-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:06 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce 1073741824" returned: 0 in 1.534s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:06 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce Jun 11 05:15:06 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:07 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce" returned: 0 in 0.796s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] <== create_volume: return (2378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:15:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.383s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6093eda5-3c3a-41c7-9d17-4a90f28f5e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d330bdc9-48dc-4b4e-a9f2-19ed6641fcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:07 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Volume volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce (6832d0d2-50f9-4b76-b76a-0be23a6a4dce): created successfully Jun 11 05:15:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d330bdc9-48dc-4b4e-a9f2-19ed6641fcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Flow 'volume_create_manager' (f8e10208-b189-43dc-8cde-66ee474830ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:07 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-4eddbfb4-deec-44a0-a056-3353ee279a91 tempest-VolumesActionsTest-691641204 None] Created volume successfully. Jun 11 05:15:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Acquiring lock "cinder-6832d0d2-50f9-4b76-b76a-0be23a6a4dce-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Lock "cinder-6832d0d2-50f9-4b76-b76a-0be23a6a4dce-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Acquiring lock "cinder-quobyte-6832d0d2-50f9-4b76-b76a-0be23a6a4dce" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Lock "cinder-quobyte-6832d0d2-50f9-4b76-b76a-0be23a6a4dce" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:08 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deeafc2-16b9-4d1b-b2b2-59a0855c937d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:08 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce Jun 11 05:15:08 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:09 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce" returned: 0 in 1.022s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:09 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce Jun 11 05:15:09 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:10 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6832d0d2-50f9-4b76-b76a-0be23a6a4dce" returned: 0 in 0.706s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Lock "cinder-quobyte-6832d0d2-50f9-4b76-b76a-0be23a6a4dce" released by "delete_volume" :: held 1.830s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:10 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Created reservations ['c36a79bd-2cc1-4155-a221-baeec83812f9', '6ea0aea9-7bfe-4cd4-9e94-75c651543843', 'a8c27e9e-c98d-4eaa-a00a-efcd01507e81', '12590fae-e908-403b-8fe6-2fe7cb699b9c'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:15:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:10 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:15:10 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:11 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.217s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:15:11 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Deleted volume successfully. Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Flow 'volume_create_manager' (21956420-3103-414a-a414-84e6529dbb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfc7806-43d8-45cf-a785-e2c97353d688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-49031e06-552f-4a94-9dbf-7d9f2bc30b52 tempest-VolumesActionsTest-817565191 None] Lock "cinder-6832d0d2-50f9-4b76-b76a-0be23a6a4dce-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfc7806-43d8-45cf-a785-e2c97353d688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1206174316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bccbb13-3b23-4b88-a46a-b63f5b7a7711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3826c8915596448c8b3d1759a559f77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:12Z,use_quota=True,user_id='ddb73b85a50f4014889554b1aac18b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa6150c-0c40-4bd3-8d05-b957454ddbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa6150c-0c40-4bd3-8d05-b957454ddbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764e806e-b6c2-4325-ad32-9e877f3fb663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764e806e-b6c2-4325-ad32-9e877f3fb663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bccbb13-3b23-4b88-a46a-b63f5b7a7711', 'volume_name': 'volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2265e6e-069c-4c10-9941-0b4c3a02550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2265e6e-069c-4c10-9941-0b4c3a02550b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126fa0e9-e5ed-47cb-9abf-d92366688c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:11 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Volume 6bccbb13-3b23-4b88-a46a-b63f5b7a7711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711', 'volume_size': 1} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1206174316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bccbb13-3b23-4b88-a46a-b63f5b7a7711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3826c8915596448c8b3d1759a559f77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:12Z,use_quota=True,user_id='ddb73b85a50f4014889554b1aac18b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Creating volume 6bccbb13-3b23-4b88-a46a-b63f5b7a7711 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:15:11 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:15:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:11 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711 1073741824 Jun 11 05:15:11 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:13 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711 1073741824" returned: 0 in 1.456s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:13 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711 Jun 11 05:15:13 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Flow 'volume_create_manager' (8c2cb089-75d4-4299-8ea2-48bf7cd3953e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f98c74-56df-4840-b7d2-1861b95f078e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f98c74-56df-4840-b7d2-1861b95f078e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1766859399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec495eb9-0a96-417d-8235-4b1d60f4c0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a91f9d733fc494785a24870cd7816a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:14Z,use_quota=True,user_id='2577bcc64cbc4b0da579053c6a710f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c86c1a-3637-4ee1-943b-4d31bf3541eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c86c1a-3637-4ee1-943b-4d31bf3541eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96400117-891e-4d32-abe6-fd8499e3cad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96400117-891e-4d32-abe6-fd8499e3cad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec495eb9-0a96-417d-8235-4b1d60f4c0b5', 'volume_name': 'volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74847cb1-e672-40d6-91fa-9012521d6874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74847cb1-e672-40d6-91fa-9012521d6874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12826de9-6a09-4dd0-a1f5-284630a3e460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:13 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Volume ec495eb9-0a96-417d-8235-4b1d60f4c0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5', 'volume_size': 1} Jun 11 05:15:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:14 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711" returned: 0 in 0.715s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] <== create_volume: return (2245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.249s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.202s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1766859399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec495eb9-0a96-417d-8235-4b1d60f4c0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a91f9d733fc494785a24870cd7816a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:14Z,use_quota=True,user_id='2577bcc64cbc4b0da579053c6a710f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Creating volume ec495eb9-0a96-417d-8235-4b1d60f4c0b5 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:15:14 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126fa0e9-e5ed-47cb-9abf-d92366688c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:14 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5 1073741824 Jun 11 05:15:14 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dace8c50-621a-45dc-9518-b7402d84f1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:14 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Volume volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711 (6bccbb13-3b23-4b88-a46a-b63f5b7a7711): created successfully Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dace8c50-621a-45dc-9518-b7402d84f1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:14 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Flow 'volume_create_manager' (21956420-3103-414a-a414-84e6529dbb2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:14 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c13a6b9f-5ae5-42b2-8850-affd3696ff75 tempest-VolumesActionsTest-691641204 None] Created volume successfully. Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Flow 'volume_create_manager' (c4380f0b-a4a0-463c-84f6-2135899b8549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:15 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff91c83-f03d-409f-a673-9c7505222eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Acquiring lock "cinder-6bccbb13-3b23-4b88-a46a-b63f5b7a7711-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5 1073741824" returned: 0 in 1.030s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff91c83-f03d-409f-a673-9c7505222eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-320437667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd5119b-4736-4edd-80b6-de10b9299c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c95426d2524062aca5d7b64803b5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:15Z,use_quota=True,user_id='2567acf66e08447cbeb5ef907674e5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(581fd598-b3d7-4f05-b961-c9e3608cc62d),volume_type_id=581fd598-b3d7-4f05-b961-c9e3608cc62d)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9985150d-5fb1-46ac-b676-d5cfd2cb259d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9985150d-5fb1-46ac-b676-d5cfd2cb259d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44e7173-7424-4a44-818a-ab9242c3d95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44e7173-7424-4a44-818a-ab9242c3d95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd5119b-4736-4edd-80b6-de10b9299c14', 'volume_name': 'volume-efd5119b-4736-4edd-80b6-de10b9299c14', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921e6ef4-5ea5-4ac3-8554-552a8f147086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921e6ef4-5ea5-4ac3-8554-552a8f147086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3357eb-5217-46e4-9ca0-31adb6b3bc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:15 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Volume efd5119b-4736-4edd-80b6-de10b9299c14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd5119b-4736-4edd-80b6-de10b9299c14', 'volume_size': 1} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Lock "cinder-6bccbb13-3b23-4b88-a46a-b63f5b7a7711-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Acquiring lock "cinder-quobyte-6bccbb13-3b23-4b88-a46a-b63f5b7a7711" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:15 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5 Jun 11 05:15:15 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Lock "cinder-quobyte-6bccbb13-3b23-4b88-a46a-b63f5b7a7711" acquired by "delete_volume" :: waited 0.017s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b913f1ca-f38b-474c-8e87-963d10973104]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:15 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711 Jun 11 05:15:15 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:15 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5" returned: 0 in 0.640s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-320437667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd5119b-4736-4edd-80b6-de10b9299c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c95426d2524062aca5d7b64803b5b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:15Z,use_quota=True,user_id='2567acf66e08447cbeb5ef907674e5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(581fd598-b3d7-4f05-b961-c9e3608cc62d),volume_type_id=581fd598-b3d7-4f05-b961-c9e3608cc62d)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Creating volume efd5119b-4736-4edd-80b6-de10b9299c14 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:15:15 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-efd5119b-4736-4edd-80b6-de10b9299c14 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:15 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-efd5119b-4736-4edd-80b6-de10b9299c14 1073741824 Jun 11 05:15:15 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12826de9-6a09-4dd0-a1f5-284630a3e460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad77de97-0964-41ff-83c6-368a5e09767d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:15 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Volume volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5 (ec495eb9-0a96-417d-8235-4b1d60f4c0b5): created successfully Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad77de97-0964-41ff-83c6-368a5e09767d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Flow 'volume_create_manager' (8c2cb089-75d4-4299-8ea2-48bf7cd3953e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:15 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e435359e-da51-4b2d-950b-c53f2e2c1a04 tempest-AttachVolumeTestJSON-196930068 None] Created volume successfully. Jun 11 05:15:15 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711" returned: 0 in 0.753s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:16 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711 Jun 11 05:15:16 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:16 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6bccbb13-3b23-4b88-a46a-b63f5b7a7711" returned: 0 in 0.663s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Lock "cinder-quobyte-6bccbb13-3b23-4b88-a46a-b63f5b7a7711" released by "delete_volume" :: held 1.456s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:16 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-efd5119b-4736-4edd-80b6-de10b9299c14 1073741824" returned: 0 in 0.851s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-efd5119b-4736-4edd-80b6-de10b9299c14 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:16 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Created reservations ['114a5c99-bcb9-4662-86c6-6b2d6f37e97f', 'b9553447-e690-4724-8b3f-90d1f491d5a6', 'fa85c697-2e86-4474-90af-aef551e622b4', '3098b100-7eee-4314-a7f3-41d8d1afc8ed'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:15:16 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-efd5119b-4736-4edd-80b6-de10b9299c14 Jun 11 05:15:16 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:16 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:16 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:16 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:15:16 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:17 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-efd5119b-4736-4edd-80b6-de10b9299c14" returned: 0 in 0.670s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3357eb-5217-46e4-9ca0-31adb6b3bc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd5119b-4736-4edd-80b6-de10b9299c14', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a77d0c-4322-40ec-8f95-6fc2491ccc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:17 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Volume volume-efd5119b-4736-4edd-80b6-de10b9299c14 (efd5119b-4736-4edd-80b6-de10b9299c14): created successfully Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a77d0c-4322-40ec-8f95-6fc2491ccc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Flow 'volume_create_manager' (c4380f0b-a4a0-463c-84f6-2135899b8549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:17 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0d21ad02-2385-497a-9a0b-0548a6125d11 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Created volume successfully. Jun 11 05:15:17 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.671s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:15:17 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Deleted volume successfully. Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a16f8b2-315d-4f04-8747-8d393a058a87 tempest-VolumesActionsTest-817565191 None] Lock "cinder-6bccbb13-3b23-4b88-a46a-b63f5b7a7711-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Flow 'volume_create_manager' (8dcfb156-6b8b-4022-ae12-d89003ce5b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3e8b0e-3647-44aa-a932-d13c7d81457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3e8b0e-3647-44aa-a932-d13c7d81457b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-143839474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d8f8c1-fa51-44a3-b82c-18d7bdeab22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3826c8915596448c8b3d1759a559f77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:18Z,use_quota=True,user_id='ddb73b85a50f4014889554b1aac18b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7244564b-05da-4db8-ad76-a4ad8b585a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7244564b-05da-4db8-ad76-a4ad8b585a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b8e048-3b7b-4484-a6b1-792d4d6d1ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b8e048-3b7b-4484-a6b1-792d4d6d1ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d8f8c1-fa51-44a3-b82c-18d7bdeab22b', 'volume_name': 'volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383b2cde-6161-4596-a6ca-31eaa9625309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383b2cde-6161-4596-a6ca-31eaa9625309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8c97f1-6ccd-4e8f-a325-e841da44eaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:17 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Volume 45d8f8c1-fa51-44a3-b82c-18d7bdeab22b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b', 'volume_size': 1} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-143839474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d8f8c1-fa51-44a3-b82c-18d7bdeab22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3826c8915596448c8b3d1759a559f77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:18Z,use_quota=True,user_id='ddb73b85a50f4014889554b1aac18b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Creating volume 45d8f8c1-fa51-44a3-b82c-18d7bdeab22b {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:15:17 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:15:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:17 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b 1073741824 Jun 11 05:15:17 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:18 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b 1073741824" returned: 0 in 0.863s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b69b3f61-7a31-4ce8-8134-f8b313937221 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b69b3f61-7a31-4ce8-8134-f8b313937221 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b69b3f61-7a31-4ce8-8134-f8b313937221 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b69b3f61-7a31-4ce8-8134-f8b313937221 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b69b3f61-7a31-4ce8-8134-f8b313937221 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:18 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b Jun 11 05:15:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b69b3f61-7a31-4ce8-8134-f8b313937221 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:18 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:18 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:15:18 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:19 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b" returned: 0 in 0.739s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:15:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8c97f1-6ccd-4e8f-a325-e841da44eaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a82d82-9ea4-4409-a6ae-5be5cd1c2310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:19 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b69b3f61-7a31-4ce8-8134-f8b313937221 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.737s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:19 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-b69b3f61-7a31-4ce8-8134-f8b313937221 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:15:19 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b69b3f61-7a31-4ce8-8134-f8b313937221 tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Retype volume completed successfully. Jun 11 05:15:19 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Volume volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b (45d8f8c1-fa51-44a3-b82c-18d7bdeab22b): created successfully Jun 11 05:15:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a82d82-9ea4-4409-a6ae-5be5cd1c2310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Flow 'volume_create_manager' (8dcfb156-6b8b-4022-ae12-d89003ce5b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:19 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c5c4ec14-c350-4ba0-8015-e5a2e68dedd8 tempest-VolumesActionsTest-691641204 None] Created volume successfully. Jun 11 05:15:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Acquiring lock "cinder-efd5119b-4736-4edd-80b6-de10b9299c14-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Lock "cinder-efd5119b-4736-4edd-80b6-de10b9299c14-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Acquiring lock "cinder-quobyte-efd5119b-4736-4edd-80b6-de10b9299c14" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Lock "cinder-quobyte-efd5119b-4736-4edd-80b6-de10b9299c14" acquired by "delete_volume" :: waited 0.022s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf45a063-7e80-496b-86f5-c19e12706241]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-efd5119b-4736-4edd-80b6-de10b9299c14 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Acquiring lock "cinder-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Lock "cinder-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Acquiring lock "cinder-quobyte-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Lock "cinder-quobyte-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55ee1f9-728e-4a91-80a9-ec4da17ae0f6]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:20 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-efd5119b-4736-4edd-80b6-de10b9299c14 Jun 11 05:15:20 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-b2d45a24-fdd8-43cc-95a2-db9816f591fd req-5c2fefe3-2c69-49b0-a9c3-54fc976b602f tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-b2d45a24-fdd8-43cc-95a2-db9816f591fd req-5c2fefe3-2c69-49b0-a9c3-54fc976b602f tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c19390-3736-4aca-a28f-5ef27d145569]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-b2d45a24-fdd8-43cc-95a2-db9816f591fd req-5c2fefe3-2c69-49b0-a9c3-54fc976b602f tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:20 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b Jun 11 05:15:20 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:20 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5 Jun 11 05:15:20 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:21 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-efd5119b-4736-4edd-80b6-de10b9299c14" returned: 0 in 0.934s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-efd5119b-4736-4edd-80b6-de10b9299c14 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:21 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-efd5119b-4736-4edd-80b6-de10b9299c14 Jun 11 05:15:21 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:21 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b" returned: 0 in 0.911s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:21 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b Jun 11 05:15:21 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:21 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-b2d45a24-fdd8-43cc-95a2-db9816f591fd req-5c2fefe3-2c69-49b0-a9c3-54fc976b602f tempest-AttachVolumeTestJSON-196930068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5" returned: 0 in 1.020s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-b2d45a24-fdd8-43cc-95a2-db9816f591fd req-5c2fefe3-2c69-49b0-a9c3-54fc976b602f tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.044s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-b2d45a24-fdd8-43cc-95a2-db9816f591fd req-5c2fefe3-2c69-49b0-a9c3-54fc976b602f tempest-AttachVolumeTestJSON-196930068 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43498c54-82fc-475b-8bcc-3cd597e90395', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:15:21 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-b2d45a24-fdd8-43cc-95a2-db9816f591fd req-5c2fefe3-2c69-49b0-a9c3-54fc976b602f tempest-AttachVolumeTestJSON-196930068 None] attachment_update completed successfully. Jun 11 05:15:21 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-efd5119b-4736-4edd-80b6-de10b9299c14" returned: 0 in 0.865s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Lock "cinder-quobyte-efd5119b-4736-4edd-80b6-de10b9299c14" released by "delete_volume" :: held 1.854s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:21 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b" returned: 0 in 0.762s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Lock "cinder-quobyte-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b" released by "delete_volume" :: held 1.739s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:21 devstack cinder-volume[92308]: WARNING cinder.quota [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:15:21 devstack cinder-volume[92308]: WARNING cinder.quota [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Created reservations ['e4a5ff23-13d6-4f23-88e2-26500ec4d3b4', 'f0881954-5f5a-4a48-a597-a283018b4cb3', 'e57a0664-2492-4237-b740-c3c975a2976b', '9afdd8bf-1be7-4a70-acd3-1a491a2adf2a'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Created reservations ['294c9268-6f09-48f2-8005-725695841011', '2f784691-5a36-42e2-9eea-4844a79a9b28', '0d449fd0-206c-4fbd-bd5c-f3b0ac08e058', '55fee356-06f9-409f-8504-068e04c7952d'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:22 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:15:22 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:22 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:15:22 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Flow 'volume_create_manager' (c98d4b57-a7df-4521-9445-6445cede2726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdf07a1-b493-4e9b-bc3c-19dde2dc2059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdf07a1-b493-4e9b-bc3c-19dde2dc2059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-998054539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3826c8915596448c8b3d1759a559f77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:23Z,use_quota=True,user_id='ddb73b85a50f4014889554b1aac18b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd05d47-4473-4d6a-913a-efd6420bc0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd05d47-4473-4d6a-913a-efd6420bc0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:23 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35bfe96f-c703-4560-a1d4-8c0b4d7453b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:23 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35bfe96f-c703-4560-a1d4-8c0b4d7453b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0', 'volume_name': 'volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6461293-dff0-4b76-8dfc-6d66dba2f070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6461293-dff0-4b76-8dfc-6d66dba2f070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6722a4-764e-47bf-8a0f-2b3bafa0b90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:23 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Volume 2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0', 'volume_size': 1} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-998054539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3826c8915596448c8b3d1759a559f77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:23Z,use_quota=True,user_id='ddb73b85a50f4014889554b1aac18b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Creating volume 2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:15:23 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.204s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.287s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:15:23 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Deleted volume successfully. Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:15:23 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Deleted volume successfully. Jun 11 05:15:23 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0 1073741824 Jun 11 05:15:23 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c4a4e0be-c2f2-42ce-9288-b33340af574e tempest-VolumeRetypeWithoutMigrationTest-1622130162 None] Lock "cinder-efd5119b-4736-4edd-80b6-de10b9299c14-delete_volume" released by "delete_volume" :: held 3.462s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ddf30324-b5c5-4dcb-8aa5-a712e6504d31 tempest-VolumesActionsTest-817565191 None] Lock "cinder-45d8f8c1-fa51-44a3-b82c-18d7bdeab22b-delete_volume" released by "delete_volume" :: held 3.292s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:24 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0 1073741824" returned: 0 in 0.964s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:24 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0 Jun 11 05:15:24 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:25 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0" returned: 0 in 0.695s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:15:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6722a4-764e-47bf-8a0f-2b3bafa0b90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0379ab-3875-49c8-9a68-5f401119aca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:25 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Volume volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0 (2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0): created successfully Jun 11 05:15:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0379ab-3875-49c8-9a68-5f401119aca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Flow 'volume_create_manager' (c98d4b57-a7df-4521-9445-6445cede2726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:25 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5c0325dc-e0ff-4caf-8944-5eaf7409517c tempest-VolumesActionsTest-691641204 None] Created volume successfully. Jun 11 05:15:25 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Acquiring lock "cinder-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:25 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Lock "cinder-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:25 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Acquiring lock "cinder-quobyte-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:25 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Lock "cinder-quobyte-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0" acquired by "delete_volume" :: waited 0.025s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:25 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8cccec-4e52-403a-a14f-9a7afec92b9c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:25 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0 Jun 11 05:15:25 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:26 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0" returned: 0 in 0.956s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:26 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0 Jun 11 05:15:26 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:27 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0" returned: 0 in 0.741s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Lock "cinder-quobyte-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0" released by "delete_volume" :: held 1.763s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:27 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Created reservations ['9d887b94-e6c5-42f2-a221-5de873fcc444', 'b57c90c0-d523-45cb-b76f-eceba0815fe7', '346ebe05-b969-446c-a92a-e252af350865', '2e2f51bb-e277-4317-b433-a04221105418'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:15:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:27 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:15:27 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:28 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.815s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:15:28 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Deleted volume successfully. Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9067d36b-912f-4aaa-a328-461b0d2c26b7 tempest-VolumesActionsTest-817565191 None] Lock "cinder-2e2cc2b6-ec07-462e-aedb-06b9a0e80ab0-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Flow 'volume_create_manager' (8dc0441e-ccc2-470d-a8a1-20829fd018ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afc2339-c952-45fe-87c7-312301eef537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afc2339-c952-45fe-87c7-312301eef537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1681224080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a14b8b-7745-43c1-a40c-7d24cd9c3d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3826c8915596448c8b3d1759a559f77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:29Z,use_quota=True,user_id='ddb73b85a50f4014889554b1aac18b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bde7584-a7fc-4dfe-adb1-b19725804253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bde7584-a7fc-4dfe-adb1-b19725804253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70483eaa-fb57-451d-b4f9-9576af5c877c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70483eaa-fb57-451d-b4f9-9576af5c877c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a14b8b-7745-43c1-a40c-7d24cd9c3d0d', 'volume_name': 'volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b8443b-8114-4760-966a-3e8581ed3547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b8443b-8114-4760-966a-3e8581ed3547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703d54b3-4464-46b3-8a19-5650ecce170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:28 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Volume 34a14b8b-7745-43c1-a40c-7d24cd9c3d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d', 'volume_size': 1} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1681224080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a14b8b-7745-43c1-a40c-7d24cd9c3d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3826c8915596448c8b3d1759a559f77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:29Z,use_quota=True,user_id='ddb73b85a50f4014889554b1aac18b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Creating volume 34a14b8b-7745-43c1-a40c-7d24cd9c3d0d {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:15:28 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:15:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:28 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d 1073741824 Jun 11 05:15:28 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:29 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d 1073741824" returned: 0 in 1.006s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:29 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d Jun 11 05:15:29 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:30 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:15:30 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:30 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d" returned: 0 in 0.747s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703d54b3-4464-46b3-8a19-5650ecce170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da52eace-a29b-4c34-a4a8-3d654a6f59be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:30 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Volume volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d (34a14b8b-7745-43c1-a40c-7d24cd9c3d0d): created successfully Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da52eace-a29b-4c34-a4a8-3d654a6f59be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Flow 'volume_create_manager' (8dc0441e-ccc2-470d-a8a1-20829fd018ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:30 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-7d6ac877-05ff-44d8-9894-f83851f6c074 tempest-VolumesActionsTest-691641204 None] Created volume successfully. Jun 11 05:15:31 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.069s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:15:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:15:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 8 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:15:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:15:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Acquiring lock "cinder-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Lock "cinder-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:31 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=89,cinder:UPDATE=120,cinder:INSERT=26,cinder:DELETE=9 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:15:31 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=111,cinder:SELECT=88,cinder:DELETE=11,cinder:INSERT=23 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:15:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Acquiring lock "cinder-quobyte-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Lock "cinder-quobyte-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d" acquired by "delete_volume" :: waited 0.022s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:32 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[093089f9-b2b3-48e0-ae15-e0e6a60f00a7]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:32 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d Jun 11 05:15:32 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:32 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d" returned: 0 in 0.906s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:32 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d Jun 11 05:15:32 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:33 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d" returned: 0 in 0.668s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Lock "cinder-quobyte-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d" released by "delete_volume" :: held 1.639s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:33 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Created reservations ['67b4506c-f3cd-4112-a940-02ecb37e0ba1', '7b712c78-a5b8-4366-9edf-183a33b4e438', '4207ec45-69ab-44a8-b65c-968e816a9e76', '61c2b368-4a0e-4ef2-b19d-34a90cbc581b'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:15:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:33 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:15:33 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:34 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.813s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:34 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:15:34 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Deleted volume successfully. Jun 11 05:15:34 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-be96c4f1-279a-4420-80cd-df7b16e79626 tempest-VolumesActionsTest-691641204 None] Lock "cinder-34a14b8b-7745-43c1-a40c-7d24cd9c3d0d-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:36 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:15:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Flow 'volume_create_manager' (dd1b58a0-0777-4967-a63f-e96783ad486e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7db7194-6e6d-42fe-b7b3-175a90bc3332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7db7194-6e6d-42fe-b7b3-175a90bc3332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1693699902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edad5386-cb7c-4ba7-940b-1c708ded65a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e02730f93094835bc93d3665a9a5df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:37Z,use_quota=True,user_id='e8ad1dae7fe5407b93a67945118ea891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3195ecc8-5f03-45ec-952e-7e6c17c53f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3195ecc8-5f03-45ec-952e-7e6c17c53f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb21f1b-fe54-435c-bfcb-15ea3588f115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:36 devstack cinder-volume[92308]: DEBUG cinder.image.glance [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Creating Keystone auth plugin from conf {{(pid=92308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 11 05:15:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb21f1b-fe54-435c-bfcb-15ea3588f115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'edad5386-cb7c-4ba7-940b-1c708ded65a7', 'volume_name': 'volume-edad5386-cb7c-4ba7-940b-1c708ded65a7', 'volume_size': 1, 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fc36ed7ee404444980e7b3d4d23270a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'created_at': datetime.datetime(2026, 6, 11, 3, 3, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 3, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5948caf3-a8c7-4db4-a99d-12690a647bd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5f1025-4ec3-4de8-90ba-95e946eab442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5f1025-4ec3-4de8-90ba-95e946eab442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c363233c-29a8-48f7-b273-3fd31cf57734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:37 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Volume edad5386-cb7c-4ba7-940b-1c708ded65a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-edad5386-cb7c-4ba7-940b-1c708ded65a7', 'volume_size': 1, 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fc36ed7ee404444980e7b3d4d23270a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'created_at': datetime.datetime(2026, 6, 11, 3, 3, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 3, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5948caf3-a8c7-4db4-a99d-12690a647bd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 11 05:15:37 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Trying to clone edad5386-cb7c-4ba7-940b-1c708ded65a7 from image 5948caf3-a8c7-4db4-a99d-12690a647bd4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]). {{(pid=92308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 11 05:15:37 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 11 05:15:37 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Image download 20.69 MB at 20.69 MB/s Jun 11 05:15:37 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2043f78a-1ca9-416b-8a53-9f28d1f180e1]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:38 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD Jun 11 05:15:38 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:38 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:38 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Temporary image 5948caf3-a8c7-4db4-a99d-12690a647bd4 is fetched for user e8ad1dae7fe5407b93a67945118ea891. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 11 05:15:38 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb902271-6256-487a-8051-784a1cb37016]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:38 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD Jun 11 05:15:38 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:39 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1693699902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edad5386-cb7c-4ba7-940b-1c708ded65a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e02730f93094835bc93d3665a9a5df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:37Z,use_quota=True,user_id='e8ad1dae7fe5407b93a67945118ea891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:15:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Creating volume edad5386-cb7c-4ba7-940b-1c708ded65a7 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:15:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:15:39 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:15:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:39 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 1073741824 Jun 11 05:15:39 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:40 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 1073741824" returned: 0 in 0.991s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:40 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 Jun 11 05:15:40 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:41 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7" returned: 0 in 0.672s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:15:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:41 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Attempting download of 5948caf3-a8c7-4db4-a99d-12690a647bd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}])) to volume edad5386-cb7c-4ba7-940b-1c708ded65a7. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 11 05:15:41 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbf6f48-cf70-4297-b2df-8160cbff1d68]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_3jd02u80 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:41 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_3jd02u80 Jun 11 05:15:41 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:42 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_3jd02u80" returned: 0 in 0.747s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_3jd02u80 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:42 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_3jd02u80 Jun 11 05:15:42 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:43 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_3jd02u80" returned: 1 in 1.298s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_3jd02u80' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:15:43 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7a9eca-5e79-4748-a078-1f0cc7d365d4]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:43 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD Jun 11 05:15:43 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:44 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD" returned: 0 in 1.116s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:44 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] 5948caf3-a8c7-4db4-a99d-12690a647bd4 was qcow2, converting to raw {{(pid=92308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 11 05:15:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:44 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 Jun 11 05:15:44 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:47 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7" returned: 0 in 3.102s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:47 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_hx8_dulrdevstack@QuobyteHD, size 112.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:15:47 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Converted 112.00 MB image at 36.07 MB/s Jun 11 05:15:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:47 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 1G Jun 11 05:15:47 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:48 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 1G" returned: 0 in 1.007s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:48 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f135c3-5130-46d2-90d4-81578f5769bd]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:48 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 Jun 11 05:15:48 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:49 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7" returned: 0 in 0.967s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:49 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 Jun 11 05:15:49 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:50 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7" returned: 1 in 0.938s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:15:50 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Downloaded image 5948caf3-a8c7-4db4-a99d-12690a647bd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}])) to volume edad5386-cb7c-4ba7-940b-1c708ded65a7 successfully. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 11 05:15:50 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Temporary image 5948caf3-a8c7-4db4-a99d-12690a647bd4 for user e8ad1dae7fe5407b93a67945118ea891 is deleted. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 11 05:15:50 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Marking volume edad5386-cb7c-4ba7-940b-1c708ded65a7 as bootable. {{(pid=92308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 11 05:15:50 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Copying metadata from image 5948caf3-a8c7-4db4-a99d-12690a647bd4 to edad5386-cb7c-4ba7-940b-1c708ded65a7. {{(pid=92308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 11 05:15:50 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Creating volume glance metadata for volume edad5386-cb7c-4ba7-940b-1c708ded65a7 backed by image 5948caf3-a8c7-4db4-a99d-12690a647bd4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 11 05:15:50 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c363233c-29a8-48f7-b273-3fd31cf57734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edad5386-cb7c-4ba7-940b-1c708ded65a7', 'volume_size': 1, 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fc36ed7ee404444980e7b3d4d23270a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'created_at': datetime.datetime(2026, 6, 11, 3, 3, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 3, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5948caf3-a8c7-4db4-a99d-12690a647bd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:50 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36c8c1d-94eb-4a6d-9cec-8d2e3f6aa9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:50 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Volume volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 (edad5386-cb7c-4ba7-940b-1c708ded65a7): created successfully Jun 11 05:15:50 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36c8c1d-94eb-4a6d-9cec-8d2e3f6aa9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Flow 'volume_create_manager' (dd1b58a0-0777-4967-a63f-e96783ad486e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:51 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9a56b375-a34d-4c7b-b1d6-4dc37a26364f tempest-VolumesImageMetadata-1204396934 None] Created volume successfully. Jun 11 05:15:52 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Acquiring lock "cinder-edad5386-cb7c-4ba7-940b-1c708ded65a7-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:52 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Lock "cinder-edad5386-cb7c-4ba7-940b-1c708ded65a7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Acquiring lock "cinder-quobyte-edad5386-cb7c-4ba7-940b-1c708ded65a7" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:15:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Lock "cinder-quobyte-edad5386-cb7c-4ba7-940b-1c708ded65a7" acquired by "delete_volume" :: waited 0.036s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:15:53 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a75a740-b2b1-4eaa-a0e4-34db1e212d36]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:53 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 Jun 11 05:15:53 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:54 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7" returned: 0 in 1.254s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Flow 'volume_create_manager' (887314a5-1fb4-4c59-adc3-f6b6142a89ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d755bb4-0c60-4593-8a10-801f531a3f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d755bb4-0c60-4593-8a10-801f531a3f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1955458158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29a60855423428b9f1139356a5f012c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:54Z,use_quota=True,user_id='d76fa6e26e53490493104930c79bb404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6424557-6005-4fee-b4e5-50bb5100f61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6424557-6005-4fee-b4e5-50bb5100f61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0c8768-d963-43b6-8741-59e0fb843158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0c8768-d963-43b6-8741-59e0fb843158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb', 'volume_name': 'volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4dcb6b-4b60-4536-9f28-0dafbb8f6444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:54 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 Jun 11 05:15:54 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4dcb6b-4b60-4536-9f28-0dafbb8f6444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb465c6-facc-4ec0-a0e9-1bcb0bc065c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:54 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Volume d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb', 'volume_size': 1} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1955458158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29a60855423428b9f1139356a5f012c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:15:54Z,use_quota=True,user_id='d76fa6e26e53490493104930c79bb404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Creating volume d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:15:54 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:15:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:54 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb 1073741824 Jun 11 05:15:54 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:55 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7" returned: 1 in 1.347s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:15:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:55 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7 Jun 11 05:15:55 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:56 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb 1073741824" returned: 0 in 1.432s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:56 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb Jun 11 05:15:56 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:57 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-edad5386-cb7c-4ba7-940b-1c708ded65a7" returned: 0 in 1.396s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Lock "cinder-quobyte-edad5386-cb7c-4ba7-940b-1c708ded65a7" released by "delete_volume" :: held 4.130s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Created reservations ['919dee9b-ce50-4fa5-b85a-796eb553aace', '30259b47-6630-4c07-a385-619f843db1b6', 'fdcd2969-f2ee-4bc7-8120-7e49442dec6b', '9aa2801a-16e4-4707-a6f0-c762443351b7'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:15:57 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb" returned: 0 in 1.277s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] <== create_volume: return (2809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.813s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb465c6-facc-4ec0-a0e9-1bcb0bc065c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221cf08d-4052-430b-9c4f-deb71c9a6ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:15:57 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:15:57 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:57 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Volume volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb (d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb): created successfully Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221cf08d-4052-430b-9c4f-deb71c9a6ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:15:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Flow 'volume_create_manager' (887314a5-1fb4-4c59-adc3-f6b6142a89ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:15:57 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-aad3c24c-6447-4996-9889-d9e8fecbbba5 tempest-SnapshotMetadataTestJSON-207983330 None] Created volume successfully. Jun 11 05:15:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:15:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:15:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] Creating offline snapshot a0ab74ed-26fe-40c7-8a86-41ecf88a5869 of volume d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:15:58 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c9372c-e53a-4c91-ba71-54587ac04e59]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:15:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:58 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb Jun 11 05:15:58 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:15:58 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.120s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:58 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:15:58 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Deleted volume successfully. Jun 11 05:15:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-95f8b9ed-f2f9-4a0e-a34e-1064921c3ee6 tempest-VolumesImageMetadata-1204396934 None] Lock "cinder-edad5386-cb7c-4ba7-940b-1c708ded65a7-delete_volume" released by "delete_volume" :: held 5.701s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:15:59 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Jun 11 05:15:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb" returned: 0 in 0.909s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:15:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:15:59 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 1G Jun 11 05:15:59 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:00 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 1G" returned: 0 in 0.966s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:00 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 Jun 11 05:16:00 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:01 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869" returned: 0 in 0.786s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:01 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 is being set with open permissions: ugo+rw Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:01 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 Jun 11 05:16:01 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Flow 'volume_create_manager' (6d69fa0e-7fb2-4e66-9374-df7e4307b4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f58231a-2b97-46d1-b0ea-32a942a6ceeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f58231a-2b97-46d1-b0ea-32a942a6ceeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1862839243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6642d4-404c-4156-a1d7-606251451108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7269a3f9dee144959ded317ba7f1395f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:01Z,use_quota=True,user_id='eb40550cd3304e8fb316d1241460adac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef37a223-408d-4088-ab69-0f1cadbcfe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef37a223-408d-4088-ab69-0f1cadbcfe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097b8a2e-52c6-49c8-ab3a-ded432b8cad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097b8a2e-52c6-49c8-ab3a-ded432b8cad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f6642d4-404c-4156-a1d7-606251451108', 'volume_name': 'volume-1f6642d4-404c-4156-a1d7-606251451108', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94236a5e-5997-4d1d-9bd0-b77440399633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94236a5e-5997-4d1d-9bd0-b77440399633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94ceb71-e6b8-4e63-bfea-3d11e3fe10fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:01 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Volume 1f6642d4-404c-4156-a1d7-606251451108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f6642d4-404c-4156-a1d7-606251451108', 'volume_size': 1} Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:01 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869" returned: 0 in 0.764s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:01 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.info Jun 11 05:16:01 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:02 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.info" returned: 0 in 0.863s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:02 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.info is being set with open permissions: ugo+rw Jun 11 05:16:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:02 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.info Jun 11 05:16:02 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:03 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.info" returned: 0 in 0.755s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.220s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.842s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1862839243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6642d4-404c-4156-a1d7-606251451108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7269a3f9dee144959ded317ba7f1395f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:01Z,use_quota=True,user_id='eb40550cd3304e8fb316d1241460adac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:16:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Creating volume 1f6642d4-404c-4156-a1d7-606251451108 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:16:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:16:03 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:16:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:03 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 1073741824 Jun 11 05:16:03 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:03 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9b766a6b-56b8-4607-89d6-764d47644923 tempest-SnapshotMetadataTestJSON-207983330 None] Create snapshot completed successfully Jun 11 05:16:04 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 1073741824" returned: 0 in 1.126s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:04 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 Jun 11 05:16:04 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:05 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108" returned: 0 in 0.734s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94ceb71-e6b8-4e63-bfea-3d11e3fe10fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6642d4-404c-4156-a1d7-606251451108', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e8e04f-bf14-4f06-993d-abdf4a999a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:05 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Volume volume-1f6642d4-404c-4156-a1d7-606251451108 (1f6642d4-404c-4156-a1d7-606251451108): created successfully Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e8e04f-bf14-4f06-993d-abdf4a999a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Flow 'volume_create_manager' (6d69fa0e-7fb2-4e66-9374-df7e4307b4ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:05 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-fe762150-955a-42f9-8df6-9a7f9581218c tempest-VolumesDeleteCascade-1738698090 None] Created volume successfully. Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Acquiring lock "cinder-a0ab74ed-26fe-40c7-8a86-41ecf88a5869-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Lock "cinder-a0ab74ed-26fe-40c7-8a86-41ecf88a5869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Acquiring lock "cinder-quobyte-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Lock "cinder-quobyte-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Acquiring lock "cinder-quobyte-a0ab74ed-26fe-40c7-8a86-41ecf88a5869" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Lock "cinder-quobyte-a0ab74ed-26fe-40c7-8a86-41ecf88a5869" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Deleting offline snapshot a0ab74ed-26fe-40c7-8a86-41ecf88a5869 of volume d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] snapshot_file for this snap is: volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c372f121-7fc5-4c21-a0a2-e8773677f0c2]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:05 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 Jun 11 05:16:05 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] Creating offline snapshot 1a92567a-4b86-432c-80ca-0f16f48a3b1f of volume 1f6642d4-404c-4156-a1d7-606251451108 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:16:06 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f498ad53-66cd-44aa-9e2d-ea433a008f41]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:06 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 Jun 11 05:16:06 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:06 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869" returned: 0 in 1.037s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:16:06 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c09ea4b-3f33-4b5e-8acf-1df2307fa6c0]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:07 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb Jun 11 05:16:07 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:07 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108" returned: 0 in 1.138s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:07 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f 1G Jun 11 05:16:07 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:07 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb" returned: 0 in 0.921s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:07 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 Jun 11 05:16:07 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:08 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f 1G" returned: 0 in 0.849s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6642d4-404c-4156-a1d7-606251451108 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:08 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6642d4-404c-4156-a1d7-606251451108 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f Jun 11 05:16:08 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:08 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869" returned: 0 in 0.760s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:08 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869 Jun 11 05:16:08 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:09 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-59ea8544-0012-4710-a905-1cde81cbeaaa req-b7ceac9d-9f30-4fde-9179-48aed23510bd tempest-AttachVolumeTestJSON-196930068 None] Terminate volume connection completed successfully. Jun 11 05:16:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-59ea8544-0012-4710-a905-1cde81cbeaaa req-b7ceac9d-9f30-4fde-9179-48aed23510bd tempest-AttachVolumeTestJSON-196930068 None] Deleting attachment 43498c54-82fc-475b-8bcc-3cd597e90395. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:16:09 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6642d4-404c-4156-a1d7-606251451108 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f" returned: 0 in 0.759s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:09 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f is being set with open permissions: ugo+rw Jun 11 05:16:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:09 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f Jun 11 05:16:09 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:09 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb.a0ab74ed-26fe-40c7-8a86-41ecf88a5869" returned: 0 in 0.716s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Lock "cinder-quobyte-a0ab74ed-26fe-40c7-8a86-41ecf88a5869" released by "_delete_snapshot" :: held 3.591s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Lock "cinder-quobyte-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb" released by "delete_snapshot" :: held 3.635s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:09 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Created reservations ['b30cb172-cd10-40e4-8e8b-c592d54ec1eb', 'ac65b036-b91e-4668-812a-11f26e908466', 'd2dd2d9a-2c81-45ef-84c8-7280e6649e9a', '798b19bf-1f4a-4b19-902b-93f15453b469'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:16:09 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Delete snapshot completed successfully. Jun 11 05:16:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8f88d882-bd5f-420a-a0cb-bd8dc530b089 tempest-SnapshotMetadataTestJSON-207983330 None] Lock "cinder-a0ab74ed-26fe-40c7-8a86-41ecf88a5869-delete_snapshot" released by "delete_snapshot" :: held 3.790s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:09 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f" returned: 0 in 0.790s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:10 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.info Jun 11 05:16:10 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Acquiring lock "cinder-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Lock "cinder-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Acquiring lock "cinder-quobyte-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Lock "cinder-quobyte-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb" acquired by "delete_volume" :: waited 0.059s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:10 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e20046-9301-4d72-81b2-116d4987fcf0]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:10 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb Jun 11 05:16:10 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:11 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.info" returned: 0 in 1.025s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:11 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.info is being set with open permissions: ugo+rw Jun 11 05:16:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:11 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.info Jun 11 05:16:11 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:11 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb" returned: 0 in 1.007s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:11 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb Jun 11 05:16:11 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:12 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.info" returned: 0 in 1.325s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.128s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:12 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9db1b2ef-286d-41cc-8dba-afb622fe97a8 tempest-VolumesDeleteCascade-1738698090 None] Create snapshot completed successfully Jun 11 05:16:12 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb" returned: 0 in 1.310s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Lock "cinder-quobyte-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb" released by "delete_volume" :: held 2.503s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:13 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Created reservations ['c3523c1b-ba54-41e9-b3eb-ba3a0ed9c5a2', '78af7800-e473-4b42-9aba-81cf3cb27064', '557ad89d-ef5c-4d7c-8d46-4f4492c81aaa', 'ab845991-bf62-4fa0-b6d0-9f8f94e2e500'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:16:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] Creating offline snapshot f777011b-b334-4c33-a07b-6e51737f349d of volume 1f6642d4-404c-4156-a1d7-606251451108 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:16:13 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2679392a-7902-4284-b5d5-542b92f98ac3]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:13 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:16:13 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:13 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f Jun 11 05:16:13 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:14 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.005s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:14 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:16:14 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Deleted volume successfully. Jun 11 05:16:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d83563e3-aa5d-42c7-b806-10ec50f1f2ff tempest-SnapshotMetadataTestJSON-207983330 None] Lock "cinder-d8b6af3d-7f1e-4cc7-bf2e-82f1f49aa3eb-delete_volume" released by "delete_volume" :: held 4.055s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:14 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f" returned: 0 in 1.280s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f6642d4-404c-4156-a1d7-606251451108(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:16:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:14 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d 1G Jun 11 05:16:14 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:15 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d 1G" returned: 0 in 1.221s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:15 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d Jun 11 05:16:15 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:16 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d" returned: 0 in 0.911s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:16 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d is being set with open permissions: ugo+rw Jun 11 05:16:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:16 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d Jun 11 05:16:16 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:17 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d" returned: 0 in 0.867s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.432s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:17 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-de6ff5cf-9632-4a20-8759-61cf993f757f tempest-VolumesDeleteCascade-1738698090 None] Create snapshot completed successfully Jun 11 05:16:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-1f6642d4-404c-4156-a1d7-606251451108-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-1f6642d4-404c-4156-a1d7-606251451108-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Performing cascade delete. {{(pid=92308) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 11 05:16:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-1a92567a-4b86-432c-80ca-0f16f48a3b1f-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-1a92567a-4b86-432c-80ca-0f16f48a3b1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-quobyte-1f6642d4-404c-4156-a1d7-606251451108" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-1f6642d4-404c-4156-a1d7-606251451108" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-quobyte-1a92567a-4b86-432c-80ca-0f16f48a3b1f" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-1a92567a-4b86-432c-80ca-0f16f48a3b1f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Deleting offline snapshot 1a92567a-4b86-432c-80ca-0f16f48a3b1f of volume 1f6642d4-404c-4156-a1d7-606251451108 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:16:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] snapshot_file for this snap is: volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:16:18 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3aa8cb-1f46-4635-8aed-a1f4e4b18c89]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:18 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f Jun 11 05:16:18 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:19 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f" returned: 0 in 0.791s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f6642d4-404c-4156-a1d7-606251451108(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:16:19 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a51576-4aa7-4019-8842-d241e84cead7]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:19 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 Jun 11 05:16:19 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:20 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108" returned: 0 in 0.761s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:20 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[77836f6e-2434-4ffe-b1a4-f105f9680bc8]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:20 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d Jun 11 05:16:20 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:21 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d" returned: 0 in 0.911s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f6642d4-404c-4156-a1d7-606251451108(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c8570f-06b7-4b0c-9086-b14eda600357]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:21 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f Jun 11 05:16:21 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Flow 'volume_create_manager' (869e1fbd-4cd7-4ba2-a70d-185e97811eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e70be4-7900-44fb-ae62-30e5cc94af1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e70be4-7900-44fb-ae62-30e5cc94af1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-63788517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4d5761-df29-4f71-88ed-24132e269c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1906bf79ea374586a3f9a8c602d92f35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:21Z,use_quota=True,user_id='061706d76eec4b218abe00f2b804d0de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5ceaf7-9977-4f13-b87a-74a0817851b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5ceaf7-9977-4f13-b87a-74a0817851b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b33b705-97cf-419e-8ab9-c405b31bf641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b33b705-97cf-419e-8ab9-c405b31bf641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea4d5761-df29-4f71-88ed-24132e269c8c', 'volume_name': 'volume-ea4d5761-df29-4f71-88ed-24132e269c8c', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11dec81e-f48d-4a5d-9b4d-47bd43a3a232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11dec81e-f48d-4a5d-9b4d-47bd43a3a232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94b7fb8-25be-4862-99cb-596285f87c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:21 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Volume ea4d5761-df29-4f71-88ed-24132e269c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea4d5761-df29-4f71-88ed-24132e269c8c', 'volume_size': 1} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-63788517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4d5761-df29-4f71-88ed-24132e269c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1906bf79ea374586a3f9a8c602d92f35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:21Z,use_quota=True,user_id='061706d76eec4b218abe00f2b804d0de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Creating volume ea4d5761-df29-4f71-88ed-24132e269c8c {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:16:21 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:16:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ea4d5761-df29-4f71-88ed-24132e269c8c 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:21 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ea4d5761-df29-4f71-88ed-24132e269c8c 1073741824 Jun 11 05:16:21 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:22 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f" returned: 0 in 0.927s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f6642d4-404c-4156-a1d7-606251451108(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c265a262-b4a8-4704-883c-02d670d2bbf1]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Flow 'volume_create_manager' (7f816278-f9be-4ab2-bd31-7512aed6688c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f950386-0638-415e-86ce-24d52c719027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f950386-0638-415e-86ce-24d52c719027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-254123114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a5119b-64d6-43a8-895f-d0e7c659fd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a533f5043f4bedbd33d27aa1bbeeb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:22Z,use_quota=True,user_id='518b2d27525841828702e0108cbcc3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db66e984-34f9-4759-a6cb-5e94f2fc4ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db66e984-34f9-4759-a6cb-5e94f2fc4ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:22 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 Jun 11 05:16:22 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457e9486-a502-450e-9ffd-0413c60ccbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457e9486-a502-450e-9ffd-0413c60ccbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a5119b-64d6-43a8-895f-d0e7c659fd1b', 'volume_name': 'volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94226e57-52d0-4342-9e5e-fa63704a2693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94226e57-52d0-4342-9e5e-fa63704a2693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042f603a-f1db-4941-8dbb-7444d393e338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:22 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Volume 76a5119b-64d6-43a8-895f-d0e7c659fd1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b', 'volume_size': 1} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:22 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ea4d5761-df29-4f71-88ed-24132e269c8c 1073741824" returned: 0 in 0.989s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ea4d5761-df29-4f71-88ed-24132e269c8c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:22 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ea4d5761-df29-4f71-88ed-24132e269c8c Jun 11 05:16:22 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:23 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108" returned: 0 in 0.934s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:23 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f Jun 11 05:16:23 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:23 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ea4d5761-df29-4f71-88ed-24132e269c8c" returned: 0 in 1.135s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.482s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-254123114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a5119b-64d6-43a8-895f-d0e7c659fd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a533f5043f4bedbd33d27aa1bbeeb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:22Z,use_quota=True,user_id='518b2d27525841828702e0108cbcc3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Creating volume 76a5119b-64d6-43a8-895f-d0e7c659fd1b {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:16:23 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:23 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b 1073741824 Jun 11 05:16:23 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94b7fb8-25be-4862-99cb-596285f87c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea4d5761-df29-4f71-88ed-24132e269c8c', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa3b9a1-c941-4ec9-94e7-a9bcf530f3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:23 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Volume volume-ea4d5761-df29-4f71-88ed-24132e269c8c (ea4d5761-df29-4f71-88ed-24132e269c8c): created successfully Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa3b9a1-c941-4ec9-94e7-a9bcf530f3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Flow 'volume_create_manager' (869e1fbd-4cd7-4ba2-a70d-185e97811eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:23 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8c7b331c-a706-4b4a-b7e2-17c109468af8 tempest-ServersNegativeTestJSON-9532519 None] Created volume successfully. Jun 11 05:16:24 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f" returned: 0 in 1.118s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:24 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f Jun 11 05:16:24 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:24 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b 1073741824" returned: 0 in 0.971s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:24 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b Jun 11 05:16:24 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:24 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.1a92567a-4b86-432c-80ca-0f16f48a3b1f" returned: 0 in 0.771s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6642d4-404c-4156-a1d7-606251451108 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d -F qcow2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:25 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6642d4-404c-4156-a1d7-606251451108 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d -F qcow2 Jun 11 05:16:25 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:25 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b" returned: 0 in 0.941s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:16:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042f603a-f1db-4941-8dbb-7444d393e338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779f9992-ca17-462f-b264-05c4ebc7bb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:25 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Volume volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b (76a5119b-64d6-43a8-895f-d0e7c659fd1b): created successfully Jun 11 05:16:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779f9992-ca17-462f-b264-05c4ebc7bb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Flow 'volume_create_manager' (7f816278-f9be-4ab2-bd31-7512aed6688c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:25 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0dacc5a9-b408-4c0e-a2b8-109885ec87ae tempest-AbsoluteLimitsTests-291540761 None] Created volume successfully. Jun 11 05:16:25 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6642d4-404c-4156-a1d7-606251451108 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d -F qcow2" returned: 0 in 0.992s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-1a92567a-4b86-432c-80ca-0f16f48a3b1f" released by "_delete_snapshot" :: held 7.418s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-1f6642d4-404c-4156-a1d7-606251451108" released by "delete_snapshot" :: held 7.446s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Created reservations ['5ddca13e-1810-461d-bf57-67b92dbba006', 'd3e5d4ab-4d9d-4214-9b15-e2aeed103a84', '568112ff-56d4-4311-8382-f45a8f76f4d7', 'efac575d-a58f-45bf-93b9-bdb7460798d2'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:16:26 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Delete snapshot completed successfully. Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-1a92567a-4b86-432c-80ca-0f16f48a3b1f-delete_snapshot" released by "delete_snapshot" :: held 7.656s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-f777011b-b334-4c33-a07b-6e51737f349d-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-f777011b-b334-4c33-a07b-6e51737f349d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-quobyte-1f6642d4-404c-4156-a1d7-606251451108" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-1f6642d4-404c-4156-a1d7-606251451108" acquired by "delete_snapshot" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-quobyte-f777011b-b334-4c33-a07b-6e51737f349d" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-f777011b-b334-4c33-a07b-6e51737f349d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Deleting offline snapshot f777011b-b334-4c33-a07b-6e51737f349d of volume 1f6642d4-404c-4156-a1d7-606251451108 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] snapshot_file for this snap is: volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2ad92e-b939-47e7-b382-e7baab03be37]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:26 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d Jun 11 05:16:26 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Flow 'volume_create_manager' (d976358b-8c9b-4bfe-9c70-d0df53eb7d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b7e76c-13f7-45df-ba70-d8b9120f6751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b7e76c-13f7-45df-ba70-d8b9120f6751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1768846742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8224eb-19bb-4836-bc4d-957c6f1a6d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1906bf79ea374586a3f9a8c602d92f35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:26Z,use_quota=True,user_id='061706d76eec4b218abe00f2b804d0de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c8b62f-a08e-4b1b-abae-41e8c29d6b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c8b62f-a08e-4b1b-abae-41e8c29d6b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f616ae80-d441-4990-bb37-3f896fcc47ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f616ae80-d441-4990-bb37-3f896fcc47ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8224eb-19bb-4836-bc4d-957c6f1a6d5f', 'volume_name': 'volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ccc681-e90f-4fc8-8646-8d61aa4a7591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ccc681-e90f-4fc8-8646-8d61aa4a7591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0243b6bd-3831-4dfe-8307-3e869f5533e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:26 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Volume 0d8224eb-19bb-4836-bc4d-957c6f1a6d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f', 'volume_size': 1} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1768846742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8224eb-19bb-4836-bc4d-957c6f1a6d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1906bf79ea374586a3f9a8c602d92f35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:26Z,use_quota=True,user_id='061706d76eec4b218abe00f2b804d0de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Creating volume 0d8224eb-19bb-4836-bc4d-957c6f1a6d5f {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:16:26 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:26 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f 1073741824 Jun 11 05:16:26 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Acquiring lock "cinder-76a5119b-64d6-43a8-895f-d0e7c659fd1b-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Lock "cinder-76a5119b-64d6-43a8-895f-d0e7c659fd1b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Acquiring lock "cinder-quobyte-76a5119b-64d6-43a8-895f-d0e7c659fd1b" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Lock "cinder-quobyte-76a5119b-64d6-43a8-895f-d0e7c659fd1b" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4e27a7-72d3-4708-a70a-b6db7e7cd6ef]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:27 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b Jun 11 05:16:27 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:27 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d" returned: 0 in 0.880s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f6642d4-404c-4156-a1d7-606251451108(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:16:27 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d105d2-fce9-4185-8ae2-3fe0ef169d91]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:27 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 Jun 11 05:16:27 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:27 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f 1073741824" returned: 0 in 0.937s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:27 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f Jun 11 05:16:27 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:27 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b" returned: 0 in 0.863s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:27 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b Jun 11 05:16:27 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:28 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108" returned: 0 in 0.957s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:28 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d Jun 11 05:16:28 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:28 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f" returned: 0 in 0.675s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0243b6bd-3831-4dfe-8307-3e869f5533e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ced3a79-7801-436d-8181-c6bff4886a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:28 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Volume volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f (0d8224eb-19bb-4836-bc4d-957c6f1a6d5f): created successfully Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ced3a79-7801-436d-8181-c6bff4886a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Flow 'volume_create_manager' (d976358b-8c9b-4bfe-9c70-d0df53eb7d0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:28 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-1a063ebe-98a7-41ee-82b2-0a3430afeb6b tempest-ServersNegativeTestJSON-9532519 None] Created volume successfully. Jun 11 05:16:28 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-76a5119b-64d6-43a8-895f-d0e7c659fd1b" returned: 0 in 0.726s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Lock "cinder-quobyte-76a5119b-64d6-43a8-895f-d0e7c659fd1b" released by "delete_volume" :: held 1.650s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Created reservations ['072b21b9-e0c6-4c24-a066-d255c1fa04ef', '75f39024-c966-4aa1-b574-6f6f16879a7a', '3dff8675-9b6b-4b9e-9949-b3eabaa5c605', 'af4408a8-b057-4a8a-87ef-decf081af156'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:28 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:16:28 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:29 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d" returned: 0 in 0.837s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:29 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d Jun 11 05:16:29 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Acquiring lock "cinder-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Lock "cinder-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Acquiring lock "cinder-quobyte-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Lock "cinder-quobyte-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f" acquired by "delete_volume" :: waited 0.033s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:29 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f898de8-0cb7-4f63-8ad1-4205fc298a0d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:29 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f Jun 11 05:16:29 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:29 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.953s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:29 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:16:29 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Deleted volume successfully. Jun 11 05:16:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fb3f1582-1a5a-4070-b74e-7be7a180d609 tempest-AbsoluteLimitsTests-291540761 None] Lock "cinder-76a5119b-64d6-43a8-895f-d0e7c659fd1b-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:30 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108.f777011b-b334-4c33-a07b-6e51737f349d" returned: 0 in 1.107s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-f777011b-b334-4c33-a07b-6e51737f349d" released by "_delete_snapshot" :: held 3.914s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-1f6642d4-404c-4156-a1d7-606251451108" released by "delete_snapshot" :: held 3.949s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:30 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:16:30 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:30 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f" returned: 0 in 1.024s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Created reservations ['2db727c5-da0a-4c67-b7f0-9be8c6af6279', 'e546c43e-5914-41fd-9da9-538d28a39c32', '6e1b6a6d-1930-4727-ae6d-3225730b841c', '7e5fa11e-3ff8-4e7b-bef0-a5b91d30755b'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:16:30 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f Jun 11 05:16:30 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:30 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Delete snapshot completed successfully. Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-f777011b-b334-4c33-a07b-6e51737f349d-delete_snapshot" released by "delete_snapshot" :: held 4.382s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Snapshots deleted, issuing volume delete {{(pid=92308) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-quobyte-1f6642d4-404c-4156-a1d7-606251451108" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-1f6642d4-404c-4156-a1d7-606251451108" acquired by "delete_volume" :: waited 0.033s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cd7c1d-cd3f-404f-b0e3-ea9380decf11]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:30 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 Jun 11 05:16:30 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:31 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.970s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:16:31 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f" returned: 0 in 1.161s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Lock "cinder-quobyte-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f" released by "delete_volume" :: held 2.260s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Created reservations ['40a3d8d1-fbf9-40d0-b03e-c75fd41d812f', '4f23bc2f-6ac9-4499-b3ed-50b1b11f3857', 'ecb1877f-e2df-4306-9f76-49cba04294a2', '7763b5af-0876-48a3-8b22-4ea01e198347'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:16:31 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108" returned: 0 in 1.041s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:31 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108 Jun 11 05:16:31 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:31 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:16:31 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:32 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.731s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:16:32 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Deleted volume successfully. Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=74,cinder:INSERT=22,cinder:UPDATE=75,cinder:DELETE=7 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:16:32 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1f6642d4-404c-4156-a1d7-606251451108" returned: 0 in 0.798s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-544b8753-7489-4896-a563-94a77b8179ce tempest-ServersNegativeTestJSON-9532519 None] Lock "cinder-0d8224eb-19bb-4836-bc4d-957c6f1a6d5f-delete_volume" released by "delete_volume" :: held 3.389s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-1f6642d4-404c-4156-a1d7-606251451108" released by "delete_volume" :: held 1.959s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=70,cinder:INSERT=31,cinder:UPDATE=85,cinder:DELETE=7 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Created reservations ['3db83b1f-be4a-4850-b4c5-b98a320d0d2e', 'f3f1a4ae-843c-4760-a864-c75c64dd753e', '51e87cac-7318-4aff-9a11-5ddaba2cae13', 'a3ebcc82-654c-4b0f-a4b9-29afb41eadd8'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Acquiring lock "cinder-ea4d5761-df29-4f71-88ed-24132e269c8c-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:32 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:16:32 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Lock "cinder-ea4d5761-df29-4f71-88ed-24132e269c8c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Acquiring lock "cinder-quobyte-ea4d5761-df29-4f71-88ed-24132e269c8c" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Lock "cinder-quobyte-ea4d5761-df29-4f71-88ed-24132e269c8c" acquired by "delete_volume" :: waited 0.031s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[026de15f-b0c6-415e-b433-33f5eb7cfcf6]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ea4d5761-df29-4f71-88ed-24132e269c8c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:33 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ea4d5761-df29-4f71-88ed-24132e269c8c Jun 11 05:16:33 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Flow 'volume_create_manager' (1aca36e6-52ae-4f74-b0df-4d7880f17567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaaf4081-e8ac-475b-9089-42982a9e7475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaaf4081-e8ac-475b-9089-42982a9e7475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1627278306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6604e3e-b190-47b9-a1e6-e113b0c3e078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7269a3f9dee144959ded317ba7f1395f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:34Z,use_quota=True,user_id='eb40550cd3304e8fb316d1241460adac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d645a870-ab7f-4167-88e1-3521228ce38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d645a870-ab7f-4167-88e1-3521228ce38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef34643-c7ad-4118-af86-6111d36b488b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:33 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef34643-c7ad-4118-af86-6111d36b488b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6604e3e-b190-47b9-a1e6-e113b0c3e078', 'volume_name': 'volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b0dc49-6602-4965-9872-da7b2546e77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b0dc49-6602-4965-9872-da7b2546e77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043b7413-4b39-4914-8dfd-0f8439ebf5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:33 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Volume d6604e3e-b190-47b9-a1e6-e113b0c3e078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078', 'volume_size': 1} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1627278306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6604e3e-b190-47b9-a1e6-e113b0c3e078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7269a3f9dee144959ded317ba7f1395f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:34Z,use_quota=True,user_id='eb40550cd3304e8fb316d1241460adac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Creating volume d6604e3e-b190-47b9-a1e6-e113b0c3e078 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:16:33 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.179s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:33 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:16:33 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 1073741824 Jun 11 05:16:33 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:33 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Deleted volume successfully. Jun 11 05:16:34 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d9a78739-4e1d-4594-9228-8551cda4fee8 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-1f6642d4-404c-4156-a1d7-606251451108-delete_volume" released by "delete_volume" :: held 15.585s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:34 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ea4d5761-df29-4f71-88ed-24132e269c8c" returned: 0 in 1.301s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ea4d5761-df29-4f71-88ed-24132e269c8c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:34 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ea4d5761-df29-4f71-88ed-24132e269c8c Jun 11 05:16:34 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:34 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 1073741824" returned: 0 in 0.919s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:34 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 Jun 11 05:16:34 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:35 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ea4d5761-df29-4f71-88ed-24132e269c8c" returned: 0 in 0.698s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Lock "cinder-quobyte-ea4d5761-df29-4f71-88ed-24132e269c8c" released by "delete_volume" :: held 2.077s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Created reservations ['5d88205b-858c-4d24-a95c-d47a4b189227', '8460fedd-99da-4466-b4bd-7b06631a2e5e', 'bc8c87af-81f0-493a-be84-d3eb4086c565', 'fe93e8c1-bc4f-486a-8408-1dd7cf875ea8'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:35 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:16:35 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:16:35 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Flow 'volume_create_manager' (4018aea7-95c3-4864-9a07-da4026eb7535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf7127d-f47e-4cd1-8bd9-27c66c357d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078" returned: 0 in 0.793s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf7127d-f47e-4cd1-8bd9-27c66c357d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-384273587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1144b8-f259-4572-a710-3879496fa1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2324680b622247ea8f062e25a5ec7a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:36Z,use_quota=True,user_id='bb74883f1e494b89939a2799906283c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5637a9-e04a-46bc-9b76-84caf1826176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5637a9-e04a-46bc-9b76-84caf1826176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d1e886-3eed-4d46-b854-7fbe9d3ea604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d1e886-3eed-4d46-b854-7fbe9d3ea604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef1144b8-f259-4572-a710-3879496fa1cb', 'volume_name': 'volume-ef1144b8-f259-4572-a710-3879496fa1cb', 'volume_size': 2}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862bbabf-7f90-4a94-9ef5-efbd854fe286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862bbabf-7f90-4a94-9ef5-efbd854fe286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65fc51f5-e706-4178-88e3-7bae0135d97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:35 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Volume ef1144b8-f259-4572-a710-3879496fa1cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef1144b8-f259-4572-a710-3879496fa1cb', 'volume_size': 2} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-384273587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1144b8-f259-4572-a710-3879496fa1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2324680b622247ea8f062e25a5ec7a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:36Z,use_quota=True,user_id='bb74883f1e494b89939a2799906283c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Creating volume ef1144b8-f259-4572-a710-3879496fa1cb {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:16:35 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ef1144b8-f259-4572-a710-3879496fa1cb 2147483648 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043b7413-4b39-4914-8dfd-0f8439ebf5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb89948-31e8-40d0-86fa-07d10b1d771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:35 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ef1144b8-f259-4572-a710-3879496fa1cb 2147483648 Jun 11 05:16:35 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:35 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Volume volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 (d6604e3e-b190-47b9-a1e6-e113b0c3e078): created successfully Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb89948-31e8-40d0-86fa-07d10b1d771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Flow 'volume_create_manager' (1aca36e6-52ae-4f74-b0df-4d7880f17567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:35 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-ad6d4015-9fd8-460d-ae7c-84009c23abd8 tempest-VolumesDeleteCascade-1738698090 None] Created volume successfully. Jun 11 05:16:36 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.759s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:36 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:16:36 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Deleted volume successfully. Jun 11 05:16:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-549c2a84-941b-401b-820d-dd1c367b6a44 tempest-ServersNegativeTestJSON-9532519 None] Lock "cinder-ea4d5761-df29-4f71-88ed-24132e269c8c-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:36 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ef1144b8-f259-4572-a710-3879496fa1cb 2147483648" returned: 0 in 1.037s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ef1144b8-f259-4572-a710-3879496fa1cb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:36 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ef1144b8-f259-4572-a710-3879496fa1cb Jun 11 05:16:36 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:37 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ef1144b8-f259-4572-a710-3879496fa1cb" returned: 0 in 0.603s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:37 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:16:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.213s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65fc51f5-e706-4178-88e3-7bae0135d97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef1144b8-f259-4572-a710-3879496fa1cb', 'volume_size': 2}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357fb331-5948-4341-8aa9-bba8bcc58f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:37 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] Creating offline snapshot a4a547fe-571c-458e-b08f-d62dd642d718 of volume d6604e3e-b190-47b9-a1e6-e113b0c3e078 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:16:37 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Volume volume-ef1144b8-f259-4572-a710-3879496fa1cb (ef1144b8-f259-4572-a710-3879496fa1cb): created successfully Jun 11 05:16:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357fb331-5948-4341-8aa9-bba8bcc58f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Flow 'volume_create_manager' (4018aea7-95c3-4864-9a07-da4026eb7535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:37 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[758fc794-0c07-4df3-9acf-d208e68fc6ec]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:37 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-4e5cd373-5e03-4fc5-8270-3bc931b27c63 tempest-VolumesCloneNegativeTest-1811382659 None] Created volume successfully. Jun 11 05:16:37 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 Jun 11 05:16:37 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Acquiring lock "cinder-ef1144b8-f259-4572-a710-3879496fa1cb-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Lock "cinder-ef1144b8-f259-4572-a710-3879496fa1cb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Acquiring lock "cinder-quobyte-ef1144b8-f259-4572-a710-3879496fa1cb" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Lock "cinder-quobyte-ef1144b8-f259-4572-a710-3879496fa1cb" acquired by "delete_volume" :: waited 0.030s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:38 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[136a0ff8-f359-4669-9edf-293f480a3d47]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ef1144b8-f259-4572-a710-3879496fa1cb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:38 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ef1144b8-f259-4572-a710-3879496fa1cb Jun 11 05:16:38 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:38 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078" returned: 0 in 0.993s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:38 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 1G Jun 11 05:16:38 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:38 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ef1144b8-f259-4572-a710-3879496fa1cb" returned: 0 in 0.822s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ef1144b8-f259-4572-a710-3879496fa1cb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:38 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ef1144b8-f259-4572-a710-3879496fa1cb Jun 11 05:16:38 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:39 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 1G" returned: 0 in 0.803s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:39 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 Jun 11 05:16:39 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:39 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ef1144b8-f259-4572-a710-3879496fa1cb" returned: 0 in 0.646s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Lock "cinder-quobyte-ef1144b8-f259-4572-a710-3879496fa1cb" released by "delete_volume" :: held 1.524s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:39 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Created reservations ['5d3a6a39-bd6f-40aa-8a43-6b6c6e197917', '33ce9801-8e20-4f0e-bbcf-2a0f55022a1a', '433b88aa-5a71-4252-8e3b-73c33657f57c', '7172fadb-732e-422c-8929-7ab6a46c9d91'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:16:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:39 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:16:39 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:40 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718" returned: 0 in 0.744s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:40 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 is being set with open permissions: ugo+rw Jun 11 05:16:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:40 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 Jun 11 05:16:40 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:40 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.635s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:40 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:16:40 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Deleted volume successfully. Jun 11 05:16:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed153789-7131-4297-b352-026f78a7c2fc tempest-VolumesCloneNegativeTest-1811382659 None] Lock "cinder-ef1144b8-f259-4572-a710-3879496fa1cb-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:40 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718" returned: 0 in 0.649s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:40 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.info Jun 11 05:16:40 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:41 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.info" returned: 0 in 0.637s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:41 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.info is being set with open permissions: ugo+rw Jun 11 05:16:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:41 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.info Jun 11 05:16:41 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:41 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.info" returned: 0 in 0.652s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.590s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:42 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-d75c90d9-9a0c-47dc-9d14-aa046b1762c9 tempest-VolumesDeleteCascade-1738698090 None] Create snapshot completed successfully Jun 11 05:16:42 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Flow 'volume_create_manager' (a65d2d29-ccdd-47f5-9a05-968af485c433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68374c94-e3a5-42e8-9cb6-c4b2db7f9525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68374c94-e3a5-42e8-9cb6-c4b2db7f9525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1641956447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa717b5-567c-46f6-97ef-6b9bbeac045b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7269a3f9dee144959ded317ba7f1395f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4a547fe-571c-458e-b08f-d62dd642d718,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:43Z,use_quota=True,user_id='eb40550cd3304e8fb316d1241460adac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59dd4cec-39af-400f-9a13-bf977f983fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59dd4cec-39af-400f-9a13-bf977f983fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1664b2c7-a87b-492a-bd54-6fe030f410eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1664b2c7-a87b-492a-bd54-6fe030f410eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0aa717b5-567c-46f6-97ef-6b9bbeac045b', 'volume_name': 'volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b', 'volume_size': 1, 'snapshot_id': 'a4a547fe-571c-458e-b08f-d62dd642d718'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c71d97-25dd-4658-bbcd-72c852939411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c71d97-25dd-4658-bbcd-72c852939411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9552c919-6270-4034-b163-6ca65a33f967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:43 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Volume 0aa717b5-567c-46f6-97ef-6b9bbeac045b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b', 'volume_size': 1, 'snapshot_id': 'a4a547fe-571c-458e-b08f-d62dd642d718'} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-quobyte-a4a547fe-571c-458e-b08f-d62dd642d718-0aa717b5-567c-46f6-97ef-6b9bbeac045b" by "_create_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-a4a547fe-571c-458e-b08f-d62dd642d718-0aa717b5-567c-46f6-97ef-6b9bbeac045b" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Creating volume 0aa717b5-567c-46f6-97ef-6b9bbeac045b from snapshot a4a547fe-571c-458e-b08f-d62dd642d718 {{(pid=92308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-quobyte-0aa717b5-567c-46f6-97ef-6b9bbeac045b" by "_copy_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-0aa717b5-567c-46f6-97ef-6b9bbeac045b" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] snapshot: a4a547fe-571c-458e-b08f-d62dd642d718, volume: 0aa717b5-567c-46f6-97ef-6b9bbeac045b, {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (a2ae17c0-ff69-449c-a37b-927a1ab5f3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02777f09-0710-4b36-91a1-464fda8f7dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[606f0925-65b7-49fe-ad0d-60fac7cdffc4]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02777f09-0710-4b36-91a1-464fda8f7dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-175828031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a442ddf7-8ec9-42ed-a042-d3df86ad9c6b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='949e6955997c486f9e74cd1498379bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:43Z,use_quota=True,user_id='d19de087f6194e1389b3943da4196690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f139387-70e4-47c6-b0af-4a25f035c1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f139387-70e4-47c6-b0af-4a25f035c1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a2b9bc-743d-4196-9f0c-1f30adfcc2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a2b9bc-743d-4196-9f0c-1f30adfcc2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a442ddf7-8ec9-42ed-a042-d3df86ad9c6b', 'volume_name': 'volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f469615f-70f0-4295-8ef9-acb26aafa1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f469615f-70f0-4295-8ef9-acb26aafa1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c494a55-8180-4e3c-98f8-16024b830d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:43 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Volume a442ddf7-8ec9-42ed-a042-d3df86ad9c6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b', 'volume_size': 1} Jun 11 05:16:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:43 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 Jun 11 05:16:43 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:44 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718" returned: 0 in 0.881s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:16:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] will copy from snapshot at /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 11 05:16:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Creating direct copy from snapshot {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 11 05:16:44 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcad40d6-3661-4f68-8520-d56673151118]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:44 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 Jun 11 05:16:44 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:44 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078" returned: 0 in 0.732s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:44 devstack cinder-volume[92308]: DEBUG cinder.utils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Path /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b not found in is_blk_device check {{(pid=92308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 11 05:16:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:44 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b Jun 11 05:16:44 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:51 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b" returned: 0 in 6.559s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:51 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b2ca69-26b5-4f74-9d82-38c897e1944a]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:51 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 Jun 11 05:16:51 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:52 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078" returned: 0 in 0.990s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:52 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078, size 1024.00 MB, duration 6.56 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:16:52 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Converted 1024.00 MB image at 156.08 MB/s Jun 11 05:16:52 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b is being set with open permissions: ugo+rw Jun 11 05:16:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:52 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b Jun 11 05:16:52 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:53 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b" returned: 0 in 0.600s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-0aa717b5-567c-46f6-97ef-6b9bbeac045b" released by "_copy_volume_from_snapshot" :: held 9.939s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-a4a547fe-571c-458e-b08f-d62dd642d718-0aa717b5-567c-46f6-97ef-6b9bbeac045b" released by "_create_volume_from_snapshot" :: held 9.990s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.748s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-175828031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a442ddf7-8ec9-42ed-a042-d3df86ad9c6b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='949e6955997c486f9e74cd1498379bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:43Z,use_quota=True,user_id='d19de087f6194e1389b3943da4196690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Creating volume a442ddf7-8ec9-42ed-a042-d3df86ad9c6b {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:16:53 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:53 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b 1073741824 Jun 11 05:16:53 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9552c919-6270-4034-b163-6ca65a33f967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b', 'volume_size': 1, 'snapshot_id': 'a4a547fe-571c-458e-b08f-d62dd642d718'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdcee043-d1a8-4422-a667-08874aa8750b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:53 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Volume volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b (0aa717b5-567c-46f6-97ef-6b9bbeac045b): created successfully Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdcee043-d1a8-4422-a667-08874aa8750b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Flow 'volume_create_manager' (a65d2d29-ccdd-47f5-9a05-968af485c433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:53 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2b279c0a-9d93-4d6a-aee6-e9a808fc6bda tempest-VolumesDeleteCascade-1738698090 None] Created volume successfully. Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-d6604e3e-b190-47b9-a1e6-e113b0c3e078-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-d6604e3e-b190-47b9-a1e6-e113b0c3e078-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Performing cascade delete. {{(pid=92308) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-a4a547fe-571c-458e-b08f-d62dd642d718-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-a4a547fe-571c-458e-b08f-d62dd642d718-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-quobyte-d6604e3e-b190-47b9-a1e6-e113b0c3e078" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-d6604e3e-b190-47b9-a1e6-e113b0c3e078" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-quobyte-a4a547fe-571c-458e-b08f-d62dd642d718" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-a4a547fe-571c-458e-b08f-d62dd642d718" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Deleting offline snapshot a4a547fe-571c-458e-b08f-d62dd642d718 of volume d6604e3e-b190-47b9-a1e6-e113b0c3e078 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] snapshot_file for this snap is: volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1ba977-4264-44b8-a7f1-b80c7457952c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:53 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 Jun 11 05:16:53 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:54 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b 1073741824" returned: 0 in 1.041s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:54 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b Jun 11 05:16:54 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:54 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718" returned: 0 in 0.906s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:16:54 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43c080f-198e-4c1b-b759-0b5fc0b6dd6f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:54 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 Jun 11 05:16:54 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:54 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b" returned: 0 in 0.786s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:16:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c494a55-8180-4e3c-98f8-16024b830d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd275bd0-b1af-40f9-8e2d-24b7128a4fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:55 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Volume volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b (a442ddf7-8ec9-42ed-a042-d3df86ad9c6b): created successfully Jun 11 05:16:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd275bd0-b1af-40f9-8e2d-24b7128a4fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (a2ae17c0-ff69-449c-a37b-927a1ab5f3be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:55 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a6126fc2-68b1-4da6-abdb-1fd2dd6fdf2d tempest-VolumesGetTest-2023276017 None] Created volume successfully. Jun 11 05:16:55 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078" returned: 0 in 0.888s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:55 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 Jun 11 05:16:55 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (79a1bc31-23df-46f2-a99e-dde69d0b8027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c592a5b-5b59-4f3e-830a-15add31e38ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c592a5b-5b59-4f3e-830a-15add31e38ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1420293068',display_name='tempest-VolumesGetTest-Volume-1460354585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f4c863-6829-4217-bac0-8a9214c27ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949e6955997c486f9e74cd1498379bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:56Z,use_quota=True,user_id='d19de087f6194e1389b3943da4196690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:56 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdfd999-f088-43e2-bce4-faee6c00c71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdfd999-f088-43e2-bce4-faee6c00c71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1833523-4887-4107-8421-f4feb4f7b4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1833523-4887-4107-8421-f4feb4f7b4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f4c863-6829-4217-bac0-8a9214c27ca0', 'volume_name': 'volume-04f4c863-6829-4217-bac0-8a9214c27ca0', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1da9a7e-7fea-45f1-9743-6265e74c222f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1da9a7e-7fea-45f1-9743-6265e74c222f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be168610-f2df-4459-9ce6-dac44a3e071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:56 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Volume 04f4c863-6829-4217-bac0-8a9214c27ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f4c863-6829-4217-bac0-8a9214c27ca0', 'volume_size': 1} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:16:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1420293068',display_name='tempest-VolumesGetTest-Volume-1460354585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f4c863-6829-4217-bac0-8a9214c27ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949e6955997c486f9e74cd1498379bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:16:56Z,use_quota=True,user_id='d19de087f6194e1389b3943da4196690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Creating volume 04f4c863-6829-4217-bac0-8a9214c27ca0 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:16:56 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-04f4c863-6829-4217-bac0-8a9214c27ca0 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718" returned: 0 in 0.888s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:56 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718 Jun 11 05:16:56 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:56 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-04f4c863-6829-4217-bac0-8a9214c27ca0 1073741824 Jun 11 05:16:56 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:57 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078.a4a547fe-571c-458e-b08f-d62dd642d718" returned: 0 in 0.791s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-a4a547fe-571c-458e-b08f-d62dd642d718" released by "_delete_snapshot" :: held 3.596s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-d6604e3e-b190-47b9-a1e6-e113b0c3e078" released by "delete_snapshot" :: held 3.621s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:57 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Created reservations ['52c43618-e6b6-4965-97da-5d8758d56e7f', '282993be-4768-4e70-838f-d17f20574bf6', '01fd5e0e-3c02-4d9f-8fd3-4e627bd2c3f0', '7e42206c-728d-4d50-8492-707873b6b51b'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:16:57 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Delete snapshot completed successfully. Jun 11 05:16:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-a4a547fe-571c-458e-b08f-d62dd642d718-delete_snapshot" released by "delete_snapshot" :: held 3.878s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Snapshots deleted, issuing volume delete {{(pid=92308) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 11 05:16:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-quobyte-d6604e3e-b190-47b9-a1e6-e113b0c3e078" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:57 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-04f4c863-6829-4217-bac0-8a9214c27ca0 1073741824" returned: 0 in 1.092s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-d6604e3e-b190-47b9-a1e6-e113b0c3e078" acquired by "delete_volume" :: waited 0.031s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:57 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d745149-adfe-47d8-ab83-516b09e02edc]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-04f4c863-6829-4217-bac0-8a9214c27ca0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:57 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-04f4c863-6829-4217-bac0-8a9214c27ca0 Jun 11 05:16:57 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:57 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 Jun 11 05:16:57 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:58 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-04f4c863-6829-4217-bac0-8a9214c27ca0" returned: 0 in 0.941s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:16:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:58 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be168610-f2df-4459-9ce6-dac44a3e071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f4c863-6829-4217-bac0-8a9214c27ca0', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9b87f6-80e9-43cf-bac3-d131e96aec7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:16:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078" returned: 0 in 1.014s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:58 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Volume volume-04f4c863-6829-4217-bac0-8a9214c27ca0 (04f4c863-6829-4217-bac0-8a9214c27ca0): created successfully Jun 11 05:16:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9b87f6-80e9-43cf-bac3-d131e96aec7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:16:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (79a1bc31-23df-46f2-a99e-dde69d0b8027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:16:58 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078 Jun 11 05:16:58 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:58 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a170c8d0-60a4-4fc7-b2fe-8e5d16f7ac87 tempest-VolumesGetTest-2023276017 None] Created volume successfully. Jun 11 05:16:59 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d6604e3e-b190-47b9-a1e6-e113b0c3e078" returned: 0 in 0.660s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-d6604e3e-b190-47b9-a1e6-e113b0c3e078" released by "delete_volume" :: held 1.777s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Created reservations ['8995b1c7-046b-420c-a8af-828187f24125', '7cc22511-2b90-45fe-b36f-8292c692d431', '93735bf2-e617-4a84-b180-5a5f1c8cf562', '27742327-6a44-427c-b1d9-0551e9b5030d'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:16:59 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:16:59 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-04f4c863-6829-4217-bac0-8a9214c27ca0-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Lock "cinder-04f4c863-6829-4217-bac0-8a9214c27ca0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-quobyte-04f4c863-6829-4217-bac0-8a9214c27ca0" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-04f4c863-6829-4217-bac0-8a9214c27ca0" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c4c39d-cc1a-4e83-8423-1d04264bb164]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:16:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-04f4c863-6829-4217-bac0-8a9214c27ca0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:00 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-04f4c863-6829-4217-bac0-8a9214c27ca0 Jun 11 05:17:00 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-0aa717b5-567c-46f6-97ef-6b9bbeac045b-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-0aa717b5-567c-46f6-97ef-6b9bbeac045b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "cinder-quobyte-0aa717b5-567c-46f6-97ef-6b9bbeac045b" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-0aa717b5-567c-46f6-97ef-6b9bbeac045b" acquired by "delete_volume" :: waited 0.029s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:00 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.151s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:00 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:17:00 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Deleted volume successfully. Jun 11 05:17:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a70daa-d87c-4070-a047-2f59b2ea7e59]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e81d3d9f-6345-43bd-a07f-074af466bec2 tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-d6604e3e-b190-47b9-a1e6-e113b0c3e078-delete_volume" released by "delete_volume" :: held 7.104s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:00 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b Jun 11 05:17:00 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:00 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-04f4c863-6829-4217-bac0-8a9214c27ca0" returned: 0 in 0.997s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-04f4c863-6829-4217-bac0-8a9214c27ca0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:01 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-04f4c863-6829-4217-bac0-8a9214c27ca0 Jun 11 05:17:01 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:01 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b" returned: 0 in 1.086s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:01 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:01 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b Jun 11 05:17:01 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-04f4c863-6829-4217-bac0-8a9214c27ca0" returned: 0 in 0.809s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:01 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-04f4c863-6829-4217-bac0-8a9214c27ca0" released by "delete_volume" :: held 1.880s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:01 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Created reservations ['b71afb07-a335-405c-b1b9-480bb189d821', '6a11bd91-b94c-4389-a496-655a16e33beb', '369b9f7e-c962-4c0b-8163-478eb73a3a81', '2c3b8aff-cbb3-48d4-9ac7-8a9951775e6e'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:02 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:17:02 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Lock "cinder-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-quobyte-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b" acquired by "delete_volume" :: waited 0.036s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[30733281-c2c0-4bd3-8542-19dd163f9e5b]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:02 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa717b5-567c-46f6-97ef-6b9bbeac045b" returned: 0 in 0.859s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:02 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-quobyte-0aa717b5-567c-46f6-97ef-6b9bbeac045b" released by "delete_volume" :: held 2.034s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:02 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Created reservations ['970125e4-f36b-4715-8d0c-1b32599d3127', '6f3856a9-267c-4c7b-8f38-a43b069003eb', '8ab46007-fff9-4cc5-ae17-a0b93058109e', 'b49f297a-72de-4203-a5aa-aaeadd701801'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:02 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:17:02 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:03 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.027s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:03 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:17:03 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Deleted volume successfully. Jun 11 05:17:03 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-83af2d78-ad1d-4cbf-9218-318aa7b89ba3 tempest-VolumesGetTest-2023276017 None] Lock "cinder-04f4c863-6829-4217-bac0-8a9214c27ca0-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:03 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b" returned: 0 in 0.887s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:03 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b Jun 11 05:17:03 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:03 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.782s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:03 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:17:03 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Deleted volume successfully. Jun 11 05:17:03 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1349626c-4bd5-4dfa-a546-cea89bc3baff tempest-VolumesDeleteCascade-1738698090 None] Lock "cinder-0aa717b5-567c-46f6-97ef-6b9bbeac045b-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:04 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b" returned: 0 in 0.685s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b" released by "delete_volume" :: held 1.644s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:04 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Created reservations ['a69ed769-0578-41dc-814e-82c6854016d3', '6e80168e-344d-40aa-a8ca-12280976e9ab', 'd21e5078-9f60-43c9-84a5-80bfebf01c3f', '476dfc6f-64a4-460e-bdab-54b0c3c85f9e'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:17:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:04 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:17:04 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:04 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.762s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:04 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:17:04 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Deleted volume successfully. Jun 11 05:17:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-63e77630-42c0-4bbe-a3be-ba04ad7cfbbc tempest-VolumesGetTest-2023276017 None] Lock "cinder-a442ddf7-8ec9-42ed-a042-d3df86ad9c6b-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (403d602c-1a4c-4c8c-ba86-ad464b0018f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09496cb-3066-4044-b904-7fe1e4e0afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09496cb-3066-4044-b904-7fe1e4e0afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1374194200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695f17ce-b456-4148-969f-69a1204974f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949e6955997c486f9e74cd1498379bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:05Z,use_quota=True,user_id='d19de087f6194e1389b3943da4196690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2162aa4c-ff2c-4391-adf8-774f8ac295ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2162aa4c-ff2c-4391-adf8-774f8ac295ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c814382-3c68-4829-a96c-2fc8a0777611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c814382-3c68-4829-a96c-2fc8a0777611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '695f17ce-b456-4148-969f-69a1204974f3', 'volume_name': 'volume-695f17ce-b456-4148-969f-69a1204974f3', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b88b4e-00f6-44dc-af45-be846e19bd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b88b4e-00f6-44dc-af45-be846e19bd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13da59dd-3ea7-46b5-be45-98d0a8a98fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:05 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Volume 695f17ce-b456-4148-969f-69a1204974f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-695f17ce-b456-4148-969f-69a1204974f3', 'volume_size': 1} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1374194200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695f17ce-b456-4148-969f-69a1204974f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949e6955997c486f9e74cd1498379bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:05Z,use_quota=True,user_id='d19de087f6194e1389b3943da4196690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Creating volume 695f17ce-b456-4148-969f-69a1204974f3 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:17:05 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:17:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:05 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 1073741824 Jun 11 05:17:05 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:06 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 1073741824" returned: 0 in 1.163s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:06 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 Jun 11 05:17:06 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:07 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3" returned: 0 in 0.813s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:17:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13da59dd-3ea7-46b5-be45-98d0a8a98fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-695f17ce-b456-4148-969f-69a1204974f3', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de522567-9e37-476a-a5fa-8c66d777e91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:07 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Volume volume-695f17ce-b456-4148-969f-69a1204974f3 (695f17ce-b456-4148-969f-69a1204974f3): created successfully Jun 11 05:17:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de522567-9e37-476a-a5fa-8c66d777e91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (403d602c-1a4c-4c8c-ba86-ad464b0018f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:07 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-25858270-82c2-4eba-95a3-81488fa8e073 tempest-VolumesGetTest-2023276017 None] Created volume successfully. Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (600cc861-1e48-4977-ba25-79a950c6a5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919766d8-1d5b-4308-9b2a-4a9100ceb8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919766d8-1d5b-4308-9b2a-4a9100ceb8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-173875947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467ed59a-2518-43da-8c53-a2664994577e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='949e6955997c486f9e74cd1498379bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=695f17ce-b456-4148-969f-69a1204974f3,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:09Z,use_quota=True,user_id='d19de087f6194e1389b3943da4196690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211c8c67-af4a-4f63-894d-8b8d3b1049fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211c8c67-af4a-4f63-894d-8b8d3b1049fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14284410-6333-4fe0-a543-845183c3bec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14284410-6333-4fe0-a543-845183c3bec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '467ed59a-2518-43da-8c53-a2664994577e', 'volume_name': 'volume-467ed59a-2518-43da-8c53-a2664994577e', 'volume_size': 1, 'source_volid': '695f17ce-b456-4148-969f-69a1204974f3', 'source_volstatus': 'available'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9652b413-c3e8-48f3-bc30-2c8e4b87038a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9652b413-c3e8-48f3-bc30-2c8e4b87038a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc11ca41-71c2-4319-8122-fd77ca12a015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:09 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Volume 467ed59a-2518-43da-8c53-a2664994577e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-467ed59a-2518-43da-8c53-a2664994577e', 'volume_size': 1, 'source_volid': '695f17ce-b456-4148-969f-69a1204974f3', 'source_volstatus': 'available'} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:09 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Cloning volume 695f17ce-b456-4148-969f-69a1204974f3 to volume 467ed59a-2518-43da-8c53-a2664994577e Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Creating offline snapshot f647aa1c-d701-48dd-a2f2-a7dd3fea74ba of volume 695f17ce-b456-4148-969f-69a1204974f3 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8880373-a462-49c5-a18b-58d1c1cbfd7c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:09 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 Jun 11 05:17:09 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Flow 'volume_create_manager' (b3b413a4-2c05-48a5-bea6-3a4753443ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cfefae-1e1e-4a98-aa19-773a5cc91332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cfefae-1e1e-4a98-aa19-773a5cc91332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1106983420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed4d178-3fa5-470f-865a-3a7fcf897629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f354a6ebca834c4b84677344277de5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:10Z,use_quota=True,user_id='aee58d8d987f4189b7d076809eb7fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cd5400-b75c-4714-a225-6a794b825d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cd5400-b75c-4714-a225-6a794b825d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb94a75a-25e5-4843-810d-bd0396399037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb94a75a-25e5-4843-810d-bd0396399037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed4d178-3fa5-470f-865a-3a7fcf897629', 'volume_name': 'volume-0ed4d178-3fa5-470f-865a-3a7fcf897629', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9aa3179-09c0-4fa1-8c64-beae96e39492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9aa3179-09c0-4fa1-8c64-beae96e39492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f88666c-8f03-44cd-9e16-ec7edaeb16a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:09 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Volume 0ed4d178-3fa5-470f-865a-3a7fcf897629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed4d178-3fa5-470f-865a-3a7fcf897629', 'volume_size': 1} Jun 11 05:17:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:10 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3" returned: 0 in 0.832s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:10 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba 1G Jun 11 05:17:10 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:11 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba 1G" returned: 0 in 0.882s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-695f17ce-b456-4148-969f-69a1204974f3 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:11 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-695f17ce-b456-4148-969f-69a1204974f3 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba Jun 11 05:17:11 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:11 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-695f17ce-b456-4148-969f-69a1204974f3 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba" returned: 0 in 0.674s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:11 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba is being set with open permissions: ugo+rw Jun 11 05:17:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:11 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba Jun 11 05:17:11 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:12 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba" returned: 0 in 0.650s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:12 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.info Jun 11 05:17:12 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:13 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.info" returned: 0 in 0.616s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:13 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.info is being set with open permissions: ugo+rw Jun 11 05:17:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:13 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.info Jun 11 05:17:13 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:13 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.info" returned: 0 in 0.594s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:13 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-quobyte-467ed59a-2518-43da-8c53-a2664994577e" by "_copy_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:13 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-467ed59a-2518-43da-8c53-a2664994577e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] snapshot: f647aa1c-d701-48dd-a2f2-a7dd3fea74ba, volume: 467ed59a-2518-43da-8c53-a2664994577e, {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 11 05:17:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:13 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3603c28-d557-4c8b-b8f1-279d25304797]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:13 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba Jun 11 05:17:13 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:14 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba" returned: 0 in 1.236s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-695f17ce-b456-4148-969f-69a1204974f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:17:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] will copy from snapshot at /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 11 05:17:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Creating direct copy from snapshot {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 11 05:17:14 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[905aae6e-7699-40e0-9991-d48b16c65db0]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:15 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 Jun 11 05:17:15 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:15 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3" returned: 0 in 0.762s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:15 devstack cinder-volume[92308]: DEBUG cinder.utils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Path /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e not found in is_blk_device check {{(pid=92308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 11 05:17:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:15 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e Jun 11 05:17:15 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:22 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=84,cinder:SELECT=60,cinder:INSERT=16,cinder:DELETE=6 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:17:22 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=61,cinder:INSERT=24,cinder:UPDATE=79,cinder:DELETE=8 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:17:24 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e" returned: 0 in 8.428s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:24 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b60bfd-10ff-4039-b7c5-05ff14d9f410]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:24 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 Jun 11 05:17:24 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:25 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3" returned: 0 in 0.936s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:25 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:17:25 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Converted 1024.00 MB image at 121.48 MB/s Jun 11 05:17:25 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e is being set with open permissions: ugo+rw Jun 11 05:17:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:25 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e Jun 11 05:17:25 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:25 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e" returned: 0 in 0.597s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:25 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-467ed59a-2518-43da-8c53-a2664994577e" released by "_copy_volume_from_snapshot" :: held 12.046s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:25 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-quobyte-f647aa1c-d701-48dd-a2f2-a7dd3fea74ba" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:25 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-f647aa1c-d701-48dd-a2f2-a7dd3fea74ba" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Deleting offline snapshot f647aa1c-d701-48dd-a2f2-a7dd3fea74ba of volume 695f17ce-b456-4148-969f-69a1204974f3 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:17:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] snapshot_file for this snap is: volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:17:25 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a2d0ba-0f25-4017-92a0-d1b9686d9303]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:25 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba Jun 11 05:17:25 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:26 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba" returned: 0 in 0.789s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-695f17ce-b456-4148-969f-69a1204974f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:17:26 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2338ea7d-5228-4a61-8abf-cf167c4f228c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:26 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 Jun 11 05:17:26 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:27 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3" returned: 0 in 0.704s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:27 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba Jun 11 05:17:27 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:27 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba" returned: 0 in 0.655s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:27 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba Jun 11 05:17:27 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:28 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3.f647aa1c-d701-48dd-a2f2-a7dd3fea74ba" returned: 0 in 0.925s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-f647aa1c-d701-48dd-a2f2-a7dd3fea74ba" released by "_delete_snapshot" :: held 3.214s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.765s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.100s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1106983420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed4d178-3fa5-470f-865a-3a7fcf897629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f354a6ebca834c4b84677344277de5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:10Z,use_quota=True,user_id='aee58d8d987f4189b7d076809eb7fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Creating volume 0ed4d178-3fa5-470f-865a-3a7fcf897629 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:17:29 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ed4d178-3fa5-470f-865a-3a7fcf897629 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc11ca41-71c2-4319-8122-fd77ca12a015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467ed59a-2518-43da-8c53-a2664994577e', 'volume_size': 1, 'source_volid': '695f17ce-b456-4148-969f-69a1204974f3', 'source_volstatus': 'available'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:29 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ed4d178-3fa5-470f-865a-3a7fcf897629 1073741824 Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542e6a49-68a8-4f81-a2e2-83cd40ce5304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:29 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:29 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Volume volume-467ed59a-2518-43da-8c53-a2664994577e (467ed59a-2518-43da-8c53-a2664994577e): created successfully Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542e6a49-68a8-4f81-a2e2-83cd40ce5304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (600cc861-1e48-4977-ba25-79a950c6a5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:29 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3c030ccb-5ad5-4fce-8b00-b236331b45c4 tempest-VolumesGetTest-2023276017 None] Created volume successfully. Jun 11 05:17:29 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ed4d178-3fa5-470f-865a-3a7fcf897629 1073741824" returned: 0 in 0.873s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ed4d178-3fa5-470f-865a-3a7fcf897629 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:29 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ed4d178-3fa5-470f-865a-3a7fcf897629 Jun 11 05:17:29 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:30 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:17:30 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:30 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ed4d178-3fa5-470f-865a-3a7fcf897629" returned: 0 in 0.765s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f88666c-8f03-44cd-9e16-ec7edaeb16a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed4d178-3fa5-470f-865a-3a7fcf897629', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03092e1-c079-4a0c-9ca4-952850225cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:30 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Volume volume-0ed4d178-3fa5-470f-865a-3a7fcf897629 (0ed4d178-3fa5-470f-865a-3a7fcf897629): created successfully Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03092e1-c079-4a0c-9ca4-952850225cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Flow 'volume_create_manager' (b3b413a4-2c05-48a5-bea6-3a4753443ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:30 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3637d1a2-0b70-459a-82b0-5078de4c290a tempest-VolumesTransfersV355Test-125459923 None] Created volume successfully. Jun 11 05:17:31 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.956s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (a6cddf9d-f720-4091-85a6-2a2e97b9e775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257d7c22-c4b0-41f5-818d-3d817a204e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257d7c22-c4b0-41f5-818d-3d817a204e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1824288862',display_name='tempest-VolumesGetTest-Volume-210894457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b48d65-a21c-4890-8147-9b695d425349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949e6955997c486f9e74cd1498379bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:31Z,use_quota=True,user_id='d19de087f6194e1389b3943da4196690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b42408d-033d-41ab-b7a8-cf84f02c9053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b42408d-033d-41ab-b7a8-cf84f02c9053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2833a3-5393-4849-bccc-843fbc82cec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2833a3-5393-4849-bccc-843fbc82cec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b48d65-a21c-4890-8147-9b695d425349', 'volume_name': 'volume-66b48d65-a21c-4890-8147-9b695d425349', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e2b3f6-8597-4348-bab0-1b8d6b5f213b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e2b3f6-8597-4348-bab0-1b8d6b5f213b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f9fb22-27a6-4223-b6b6-5e3504c40ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:31 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Volume 66b48d65-a21c-4890-8147-9b695d425349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b48d65-a21c-4890-8147-9b695d425349', 'volume_size': 1} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1824288862',display_name='tempest-VolumesGetTest-Volume-210894457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b48d65-a21c-4890-8147-9b695d425349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949e6955997c486f9e74cd1498379bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:31Z,use_quota=True,user_id='d19de087f6194e1389b3943da4196690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Creating volume 66b48d65-a21c-4890-8147-9b695d425349 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:17:31 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:17:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66b48d65-a21c-4890-8147-9b695d425349 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:31 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66b48d65-a21c-4890-8147-9b695d425349 1073741824 Jun 11 05:17:31 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:32 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66b48d65-a21c-4890-8147-9b695d425349 1073741824" returned: 0 in 0.976s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66b48d65-a21c-4890-8147-9b695d425349 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:32 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66b48d65-a21c-4890-8147-9b695d425349 Jun 11 05:17:32 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:32 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-66188ef1-02f8-426a-afbb-5398894c6b6e tempest-VolumesTransfersV355Test-844024976 None] Transfer volume completed successfully. Jun 11 05:17:33 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66b48d65-a21c-4890-8147-9b695d425349" returned: 0 in 0.700s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f9fb22-27a6-4223-b6b6-5e3504c40ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b48d65-a21c-4890-8147-9b695d425349', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c113e3-ecae-4596-9be4-36decd4b686a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:33 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Volume volume-66b48d65-a21c-4890-8147-9b695d425349 (66b48d65-a21c-4890-8147-9b695d425349): created successfully Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c113e3-ecae-4596-9be4-36decd4b686a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (a6cddf9d-f720-4091-85a6-2a2e97b9e775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:33 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c0c04932-8c03-4a78-9084-ec62d3092ffe tempest-VolumesGetTest-2023276017 None] Created volume successfully. Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Acquiring lock "cinder-0ed4d178-3fa5-470f-865a-3a7fcf897629-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-66b48d65-a21c-4890-8147-9b695d425349-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Lock "cinder-0ed4d178-3fa5-470f-865a-3a7fcf897629-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Lock "cinder-66b48d65-a21c-4890-8147-9b695d425349-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Acquiring lock "cinder-quobyte-0ed4d178-3fa5-470f-865a-3a7fcf897629" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-quobyte-66b48d65-a21c-4890-8147-9b695d425349" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Lock "cinder-quobyte-0ed4d178-3fa5-470f-865a-3a7fcf897629" acquired by "delete_volume" :: waited 0.037s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-66b48d65-a21c-4890-8147-9b695d425349" acquired by "delete_volume" :: waited 0.056s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a5dcea-e4a8-44fe-ba7d-b945b39f5281]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ed4d178-3fa5-470f-865a-3a7fcf897629 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce74cfe-d9f4-4f7d-9841-7ebaf471d2ea]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66b48d65-a21c-4890-8147-9b695d425349 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:34 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ed4d178-3fa5-470f-865a-3a7fcf897629 Jun 11 05:17:34 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:34 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66b48d65-a21c-4890-8147-9b695d425349 Jun 11 05:17:34 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:34 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ed4d178-3fa5-470f-865a-3a7fcf897629" returned: 0 in 0.929s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ed4d178-3fa5-470f-865a-3a7fcf897629 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:34 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ed4d178-3fa5-470f-865a-3a7fcf897629 Jun 11 05:17:34 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:34 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66b48d65-a21c-4890-8147-9b695d425349" returned: 0 in 1.010s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66b48d65-a21c-4890-8147-9b695d425349 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:34 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66b48d65-a21c-4890-8147-9b695d425349 Jun 11 05:17:34 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:35 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ed4d178-3fa5-470f-865a-3a7fcf897629" returned: 0 in 0.666s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Lock "cinder-quobyte-0ed4d178-3fa5-470f-865a-3a7fcf897629" released by "delete_volume" :: held 1.676s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Created reservations ['15c13da8-312e-47b3-bd0b-47c2bf9a29e3', 'ef1a5352-2031-4fdb-82f7-767a518bde65', '5cdf21f2-4139-4825-a84a-c7e9fb5b70cb', '912c7c29-2b7d-4746-9f86-ed9d57c0fc3d'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:35 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66b48d65-a21c-4890-8147-9b695d425349" returned: 0 in 0.751s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-66b48d65-a21c-4890-8147-9b695d425349" released by "delete_volume" :: held 1.829s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:35 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:17:35 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Created reservations ['47ef6349-d09a-41f9-ace5-0be260a85461', 'e3eacd38-55b4-4a05-b5da-40a4fcc4f58c', '0616c92a-c3c9-44c8-836e-b2c70a1da008', 'fe844efd-9667-4a80-aa9f-f99f14c90a91'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:35 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:17:35 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-467ed59a-2518-43da-8c53-a2664994577e-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Lock "cinder-467ed59a-2518-43da-8c53-a2664994577e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-quobyte-467ed59a-2518-43da-8c53-a2664994577e" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-467ed59a-2518-43da-8c53-a2664994577e" acquired by "delete_volume" :: waited 0.032s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[67847976-f43a-44a0-8e10-ab2f34b945fa]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:36 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e Jun 11 05:17:36 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:17:36 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Flow 'volume_create_manager' (5d6e3b0f-9336-4be8-b5cf-7dfcc0cdac6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f835f4-1960-4d02-b640-c735761a2507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.258s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f835f4-1960-4d02-b640-c735761a2507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1855182157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1375e275-067c-4cb2-826f-b70f93aee371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f354a6ebca834c4b84677344277de5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:37Z,use_quota=True,user_id='aee58d8d987f4189b7d076809eb7fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f3c196-4362-432c-99c5-b66417cf951a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f3c196-4362-432c-99c5-b66417cf951a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31855de1-92ed-4eeb-aaff-678be96ce80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31855de1-92ed-4eeb-aaff-678be96ce80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1375e275-067c-4cb2-826f-b70f93aee371', 'volume_name': 'volume-1375e275-067c-4cb2-826f-b70f93aee371', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03562bf1-16c3-4522-a81c-bb1a7b0437f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03562bf1-16c3-4522-a81c-bb1a7b0437f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c411264-7bf0-4511-91cc-42a69fd90686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:36 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Volume 1375e275-067c-4cb2-826f-b70f93aee371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1375e275-067c-4cb2-826f-b70f93aee371', 'volume_size': 1} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1855182157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1375e275-067c-4cb2-826f-b70f93aee371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f354a6ebca834c4b84677344277de5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:37Z,use_quota=True,user_id='aee58d8d987f4189b7d076809eb7fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Creating volume 1375e275-067c-4cb2-826f-b70f93aee371 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:17:36 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:17:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1375e275-067c-4cb2-826f-b70f93aee371 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:37 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Deleted volume successfully. Jun 11 05:17:37 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1375e275-067c-4cb2-826f-b70f93aee371 1073741824 Jun 11 05:17:37 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-405f0826-4c37-414f-bb84-2c49056eefd7 tempest-VolumesTransfersV355Test-785497774 None] Lock "cinder-0ed4d178-3fa5-470f-865a-3a7fcf897629-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:37 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.199s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:17:37 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Deleted volume successfully. Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f471960f-b1e6-4d95-9376-1003cde557aa tempest-VolumesGetTest-2023276017 None] Lock "cinder-66b48d65-a21c-4890-8147-9b695d425349-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:37 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e" returned: 0 in 1.212s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:37 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e Jun 11 05:17:37 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Flow 'volume_create_manager' (33da319a-89c6-4be9-9f60-355d77686a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc086dff-4a97-4ed5-8125-c5432b122789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc086dff-4a97-4ed5-8125-c5432b122789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1421457154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ccd656-42cb-4240-920c-cc14eda5ac27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a91f9d733fc494785a24870cd7816a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:38Z,use_quota=True,user_id='2577bcc64cbc4b0da579053c6a710f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02a2514-9ba9-45ec-8850-6cd6e86ae8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02a2514-9ba9-45ec-8850-6cd6e86ae8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49d2df9-fb53-47c9-baf3-14fd49a52794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49d2df9-fb53-47c9-baf3-14fd49a52794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ccd656-42cb-4240-920c-cc14eda5ac27', 'volume_name': 'volume-d5ccd656-42cb-4240-920c-cc14eda5ac27', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44181d59-bd32-4ebc-9a13-2ad59711102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44181d59-bd32-4ebc-9a13-2ad59711102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8309202c-8698-4b34-9df1-7d19cf669485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:37 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Volume d5ccd656-42cb-4240-920c-cc14eda5ac27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ccd656-42cb-4240-920c-cc14eda5ac27', 'volume_size': 1} Jun 11 05:17:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:38 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1375e275-067c-4cb2-826f-b70f93aee371 1073741824" returned: 0 in 1.038s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1375e275-067c-4cb2-826f-b70f93aee371 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:38 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1375e275-067c-4cb2-826f-b70f93aee371 Jun 11 05:17:38 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:38 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-467ed59a-2518-43da-8c53-a2664994577e" returned: 0 in 0.647s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-467ed59a-2518-43da-8c53-a2664994577e" released by "delete_volume" :: held 1.925s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Created reservations ['ad192306-dd5f-4f31-bed0-d0ce53652abb', '864e2936-e238-4e35-8106-d79fffd76042', '6677f542-8df8-420f-abfd-beca1c5472fc', '85bf08fa-1dc1-4991-a41a-56e76740e911'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:38 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:17:38 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-695f17ce-b456-4148-969f-69a1204974f3-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Lock "cinder-695f17ce-b456-4148-969f-69a1204974f3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-quobyte-695f17ce-b456-4148-969f-69a1204974f3" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:38 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1375e275-067c-4cb2-826f-b70f93aee371" returned: 0 in 0.692s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1421457154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ccd656-42cb-4240-920c-cc14eda5ac27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a91f9d733fc494785a24870cd7816a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:38Z,use_quota=True,user_id='2577bcc64cbc4b0da579053c6a710f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Creating volume d5ccd656-42cb-4240-920c-cc14eda5ac27 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:17:38 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-695f17ce-b456-4148-969f-69a1204974f3" acquired by "delete_volume" :: waited 0.052s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:38 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27 1073741824 Jun 11 05:17:38 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3fe13c-1852-4b36-a3cf-1aff2be6c99b]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c411264-7bf0-4511-91cc-42a69fd90686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1375e275-067c-4cb2-826f-b70f93aee371', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e9e9c0-189d-4315-84e8-f56cb51fbf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:38 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Volume volume-1375e275-067c-4cb2-826f-b70f93aee371 (1375e275-067c-4cb2-826f-b70f93aee371): created successfully Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e9e9c0-189d-4315-84e8-f56cb51fbf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Flow 'volume_create_manager' (5d6e3b0f-9336-4be8-b5cf-7dfcc0cdac6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:38 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c641c10e-e62e-4ee8-9b81-f10edb9331ec tempest-VolumesTransfersV355Test-125459923 None] Created volume successfully. Jun 11 05:17:39 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 Jun 11 05:17:39 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:39 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.061s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:39 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:17:39 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Deleted volume successfully. Jun 11 05:17:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c2e041ef-5e4d-41ab-b30b-cc59569aeaf1 tempest-VolumesGetTest-2023276017 None] Lock "cinder-467ed59a-2518-43da-8c53-a2664994577e-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:39 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3" returned: 0 in 0.846s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:39 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3 Jun 11 05:17:39 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:39 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27 1073741824" returned: 0 in 1.005s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:39 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27 Jun 11 05:17:39 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Acquiring lock "cinder-1375e275-067c-4cb2-826f-b70f93aee371-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Lock "cinder-1375e275-067c-4cb2-826f-b70f93aee371-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Acquiring lock "cinder-quobyte-1375e275-067c-4cb2-826f-b70f93aee371" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Lock "cinder-quobyte-1375e275-067c-4cb2-826f-b70f93aee371" acquired by "delete_volume" :: waited 0.046s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:40 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-695f17ce-b456-4148-969f-69a1204974f3" returned: 0 in 0.851s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e47e35-9616-4442-b8f0-218102d8dc9f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1375e275-067c-4cb2-826f-b70f93aee371 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-695f17ce-b456-4148-969f-69a1204974f3" released by "delete_volume" :: held 1.805s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:40 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27" returned: 0 in 0.830s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Created reservations ['27bf66a0-e393-475e-90cd-c1867e088d32', 'c6dc389d-0fbe-451a-9f22-eb733d24bff1', 'ec98a548-4fe2-417c-8504-c501ca0f41c9', 'd5a5cac8-d896-42d5-9beb-85313bbebbf0'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8309202c-8698-4b34-9df1-7d19cf669485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ccd656-42cb-4240-920c-cc14eda5ac27', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e956d767-9552-4e7d-97a5-afc530f3987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:40 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1375e275-067c-4cb2-826f-b70f93aee371 Jun 11 05:17:40 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:40 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Volume volume-d5ccd656-42cb-4240-920c-cc14eda5ac27 (d5ccd656-42cb-4240-920c-cc14eda5ac27): created successfully Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e956d767-9552-4e7d-97a5-afc530f3987a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Flow 'volume_create_manager' (33da319a-89c6-4be9-9f60-355d77686a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:40 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5f06461f-9629-43e6-80a2-0dab21f79295 tempest-AttachVolumeTestJSON-196930068 None] Created volume successfully. Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:40 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:17:40 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:41 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1375e275-067c-4cb2-826f-b70f93aee371" returned: 0 in 0.936s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1375e275-067c-4cb2-826f-b70f93aee371 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:41 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1375e275-067c-4cb2-826f-b70f93aee371 Jun 11 05:17:41 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:41 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.944s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:41 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:17:41 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Deleted volume successfully. Jun 11 05:17:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8d03b4d3-8365-484f-9e6b-895cea909173 tempest-VolumesGetTest-2023276017 None] Lock "cinder-695f17ce-b456-4148-969f-69a1204974f3-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:41 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:17:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (cd70112b-4c77-4004-a913-2c9f7a71d17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b304a8e2-445f-4fe7-bd7a-ad06a0ec32cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b304a8e2-445f-4fe7-bd7a-ad06a0ec32cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1036510198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4eaab3-4196-41ba-97d1-e4e81c8f49be,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='949e6955997c486f9e74cd1498379bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:42Z,use_quota=True,user_id='d19de087f6194e1389b3943da4196690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa5713f-49ee-40b0-acf9-3faf57785d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa5713f-49ee-40b0-acf9-3faf57785d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4343a4ea-19e5-44a3-bc4c-3044d21f1147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:41 devstack cinder-volume[92308]: DEBUG cinder.image.glance [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Creating Keystone auth plugin from conf {{(pid=92308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 11 05:17:42 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1375e275-067c-4cb2-826f-b70f93aee371" returned: 0 in 0.656s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Lock "cinder-quobyte-1375e275-067c-4cb2-826f-b70f93aee371" released by "delete_volume" :: held 1.646s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Created reservations ['61996edd-db5c-493c-ba55-cd537f220331', '0f9b2c3a-bbaa-4e6b-b8b6-28f3ecc47aa0', 'b35dcc2e-a1b3-4276-a623-84ec00268544', 'f36cb9eb-fe8d-4c8b-bbed-38c2457aac51'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:42 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:17:42 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4343a4ea-19e5-44a3-bc4c-3044d21f1147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc4eaab3-4196-41ba-97d1-e4e81c8f49be', 'volume_name': 'volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be', 'volume_size': 1, 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fc36ed7ee404444980e7b3d4d23270a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'created_at': datetime.datetime(2026, 6, 11, 3, 3, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 3, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5948caf3-a8c7-4db4-a99d-12690a647bd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e827b8-e6fb-4658-b6f8-36f0dd980d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e827b8-e6fb-4658-b6f8-36f0dd980d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ef4c19-2598-4206-bccb-80181b5fbb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:42 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Volume cc4eaab3-4196-41ba-97d1-e4e81c8f49be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be', 'volume_size': 1, 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fc36ed7ee404444980e7b3d4d23270a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'created_at': datetime.datetime(2026, 6, 11, 3, 3, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 3, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5948caf3-a8c7-4db4-a99d-12690a647bd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Trying to clone cc4eaab3-4196-41ba-97d1-e4e81c8f49be from image 5948caf3-a8c7-4db4-a99d-12690a647bd4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]). {{(pid=92308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 11 05:17:42 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Image download 20.69 MB at 20.69 MB/s Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[694aa398-9c77-4e84-b4ce-613c6f839df7]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:42 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD Jun 11 05:17:42 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:43 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.738s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:43 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:17:43 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Deleted volume successfully. Jun 11 05:17:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-843aeda7-2250-4f9f-94f7-f1bbb889b199 tempest-VolumesTransfersV355Test-785497774 None] Lock "cinder-1375e275-067c-4cb2-826f-b70f93aee371-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:43 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:43 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Temporary image 5948caf3-a8c7-4db4-a99d-12690a647bd4 is fetched for user d19de087f6194e1389b3943da4196690. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 11 05:17:43 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34ec91b-8621-477b-9507-5549a623dc3d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:43 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD Jun 11 05:17:43 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:44 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1036510198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4eaab3-4196-41ba-97d1-e4e81c8f49be,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='949e6955997c486f9e74cd1498379bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:42Z,use_quota=True,user_id='d19de087f6194e1389b3943da4196690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:17:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Creating volume cc4eaab3-4196-41ba-97d1-e4e81c8f49be {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:17:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:17:44 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:17:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:44 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be 1073741824 Jun 11 05:17:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-94964966-6f06-4a38-94b4-cf2a82f85cf7 req-04288b13-dab0-4d88-99b7-b966f2127e4c tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:44 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:45 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be 1073741824" returned: 0 in 0.871s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:45 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be Jun 11 05:17:45 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:45 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be" returned: 0 in 0.652s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:45 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:17:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-94964966-6f06-4a38-94b4-cf2a82f85cf7 req-04288b13-dab0-4d88-99b7-b966f2127e4c tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.526s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:45 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fbc5c5-02c8-4979-8e38-f241f482e02b]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-94964966-6f06-4a38-94b4-cf2a82f85cf7 req-04288b13-dab0-4d88-99b7-b966f2127e4c tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:45 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Attempting download of 5948caf3-a8c7-4db4-a99d-12690a647bd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}])) to volume cc4eaab3-4196-41ba-97d1-e4e81c8f49be. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 11 05:17:46 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea8ccc6-bca4-4182-aacd-5db328f5b3c4]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_k5b1lb_g {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:46 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27 Jun 11 05:17:46 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:46 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_k5b1lb_g Jun 11 05:17:46 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:46 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-94964966-6f06-4a38-94b4-cf2a82f85cf7 req-04288b13-dab0-4d88-99b7-b966f2127e4c tempest-AttachVolumeTestJSON-196930068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27" returned: 0 in 0.799s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-94964966-6f06-4a38-94b4-cf2a82f85cf7 req-04288b13-dab0-4d88-99b7-b966f2127e4c tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.821s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:46 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_k5b1lb_g" returned: 0 in 0.738s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_k5b1lb_g {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-94964966-6f06-4a38-94b4-cf2a82f85cf7 req-04288b13-dab0-4d88-99b7-b966f2127e4c tempest-AttachVolumeTestJSON-196930068 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-d5ccd656-42cb-4240-920c-cc14eda5ac27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ebe1ba2-ee58-465a-a7d7-de8ba4d2c16c', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:17:46 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-94964966-6f06-4a38-94b4-cf2a82f85cf7 req-04288b13-dab0-4d88-99b7-b966f2127e4c tempest-AttachVolumeTestJSON-196930068 None] attachment_update completed successfully. Jun 11 05:17:46 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_k5b1lb_g Jun 11 05:17:46 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:47 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_k5b1lb_g" returned: 1 in 0.737s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_k5b1lb_g' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:17:47 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e34e52-6d20-4b97-bbbf-ee6d3c4a132c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:47 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD Jun 11 05:17:47 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:48 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:48 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] 5948caf3-a8c7-4db4-a99d-12690a647bd4 was qcow2, converting to raw {{(pid=92308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 11 05:17:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:48 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be Jun 11 05:17:48 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:49 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:17:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Flow 'volume_create_manager' (d5a81de1-0a4d-4679-8a7c-11ad503fde1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e782e6-ace9-443f-a61d-99198e27780b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e782e6-ace9-443f-a61d-99198e27780b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1063027344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4aa063cfa54f8b922422084ed2801e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:50Z,use_quota=True,user_id='d0a7f5b51ae04390b7f4d8d789c61c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc920033-4e5c-4b97-a1fd-c787a32bf38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc920033-4e5c-4b97-a1fd-c787a32bf38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3f458c-b875-4eac-afe9-5c63499b8aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3f458c-b875-4eac-afe9-5c63499b8aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a', 'volume_name': 'volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90455d84-bf67-46d6-a263-7940dc3b6d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90455d84-bf67-46d6-a263-7940dc3b6d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563ce0ab-6a5f-4bfa-a035-89124deaa240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:50 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Volume 2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a', 'volume_size': 1} Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1063027344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4aa063cfa54f8b922422084ed2801e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:50Z,use_quota=True,user_id='d0a7f5b51ae04390b7f4d8d789c61c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Creating volume 2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:17:50 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:50 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a 1073741824 Jun 11 05:17:50 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:50 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be" returned: 0 in 2.222s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_qja1y2ujdevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:17:50 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Converted 112.00 MB image at 50.37 MB/s Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:50 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be 1G Jun 11 05:17:50 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:50 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a 1073741824" returned: 0 in 0.930s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:51 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a Jun 11 05:17:51 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:51 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be 1G" returned: 0 in 0.717s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:51 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd79227-076b-4132-9977-9790dc409809]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:51 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be Jun 11 05:17:51 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:51 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a" returned: 0 in 0.699s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:17:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563ce0ab-6a5f-4bfa-a035-89124deaa240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50d3150-8765-4358-9b4e-15b5a2d8bbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:51 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Volume volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a (2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a): created successfully Jun 11 05:17:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50d3150-8765-4358-9b4e-15b5a2d8bbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Flow 'volume_create_manager' (d5a81de1-0a4d-4679-8a7c-11ad503fde1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:51 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-cd4d2709-9664-443e-8be9-ac6eafd42b3f tempest-VolumesTransfersV357Test-227941904 None] Created volume successfully. Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:17:52 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Flow 'volume_create_manager' (0e671c22-f5a7-4c41-8037-7944af5fb8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b41e5f-fa82-4c2e-afd1-2f24b59218a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be" returned: 0 in 0.932s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b41e5f-fa82-4c2e-afd1-2f24b59218a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1201606236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b6233e-e5d8-4e3a-9485-11e395763938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a91f9d733fc494785a24870cd7816a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:52Z,use_quota=True,user_id='2577bcc64cbc4b0da579053c6a710f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b84e69-8561-4563-b334-d6d868e7d847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b84e69-8561-4563-b334-d6d868e7d847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0637eacf-5ad3-428e-a565-1fcb4e78ddeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0637eacf-5ad3-428e-a565-1fcb4e78ddeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b6233e-e5d8-4e3a-9485-11e395763938', 'volume_name': 'volume-74b6233e-e5d8-4e3a-9485-11e395763938', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d333e6a6-3577-4974-bb1d-9886dd8254eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d333e6a6-3577-4974-bb1d-9886dd8254eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0236d1f0-5616-4d65-81f1-04614b8735ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:52 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Volume 74b6233e-e5d8-4e3a-9485-11e395763938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b6233e-e5d8-4e3a-9485-11e395763938', 'volume_size': 1} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1201606236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b6233e-e5d8-4e3a-9485-11e395763938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a91f9d733fc494785a24870cd7816a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:52Z,use_quota=True,user_id='2577bcc64cbc4b0da579053c6a710f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Creating volume 74b6233e-e5d8-4e3a-9485-11e395763938 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:17:52 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:17:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:52 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938 1073741824 Jun 11 05:17:52 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:52 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be Jun 11 05:17:52 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:52 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-62b12f69-2608-41c4-a816-1a3f2cc5e68f tempest-VolumesTransfersV357Test-22198268 None] Transfer volume completed successfully. Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Flow 'volume_create_manager' (5b3f24cf-adfe-4545-b0b2-ac527ff0eae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db11935-8635-4122-b497-7e38905ac105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:53 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:53 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be" returned: 1 in 1.046s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Downloaded image 5948caf3-a8c7-4db4-a99d-12690a647bd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}])) to volume cc4eaab3-4196-41ba-97d1-e4e81c8f49be successfully. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Temporary image 5948caf3-a8c7-4db4-a99d-12690a647bd4 for user d19de087f6194e1389b3943da4196690 is deleted. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Marking volume cc4eaab3-4196-41ba-97d1-e4e81c8f49be as bootable. {{(pid=92308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938 1073741824" returned: 0 in 0.970s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db11935-8635-4122-b497-7e38905ac105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-831602603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b99600-0610-4f2a-8d83-3c8c70bef77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d18a39d02875433086d5f91c14ed92a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:53Z,use_quota=True,user_id='fb06bed8ad484f9792ccca64e542e62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b35d2c6-6a35-4535-ad72-31816ed81cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b35d2c6-6a35-4535-ad72-31816ed81cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71e0293-ffb2-4160-b8cc-119f9545fae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71e0293-ffb2-4160-b8cc-119f9545fae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b99600-0610-4f2a-8d83-3c8c70bef77f', 'volume_name': 'volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb71f2d-66ea-4705-a3c1-ef330b105396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb71f2d-66ea-4705-a3c1-ef330b105396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a169daea-f84c-4834-b5de-0061862df107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:53 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Volume b6b99600-0610-4f2a-8d83-3c8c70bef77f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f', 'volume_size': 1} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Copying metadata from image 5948caf3-a8c7-4db4-a99d-12690a647bd4 to cc4eaab3-4196-41ba-97d1-e4e81c8f49be. {{(pid=92308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Creating volume glance metadata for volume cc4eaab3-4196-41ba-97d1-e4e81c8f49be backed by image 5948caf3-a8c7-4db4-a99d-12690a647bd4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:53 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938 Jun 11 05:17:53 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ef4c19-2598-4206-bccb-80181b5fbb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be', 'volume_size': 1, 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fc36ed7ee404444980e7b3d4d23270a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'created_at': datetime.datetime(2026, 6, 11, 3, 3, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 3, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5948caf3-a8c7-4db4-a99d-12690a647bd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be007c4-5226-445e-8120-ba913faa17f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:53 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Volume volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be (cc4eaab3-4196-41ba-97d1-e4e81c8f49be): created successfully Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be007c4-5226-445e-8120-ba913faa17f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (cd70112b-4c77-4004-a913-2c9f7a71d17b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:53 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-ac99142e-61c6-4cfb-9e18-d39a33d66c45 tempest-VolumesGetTest-2023276017 None] Created volume successfully. Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Acquiring lock "cinder-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Lock "cinder-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Acquiring lock "cinder-quobyte-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Lock "cinder-quobyte-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a" acquired by "delete_volume" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c75c3a1-d46d-43fd-8be8-c35a296c4b5b]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:53 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938" returned: 0 in 0.641s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:53 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.689s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:53 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-831602603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b99600-0610-4f2a-8d83-3c8c70bef77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d18a39d02875433086d5f91c14ed92a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:53Z,use_quota=True,user_id='fb06bed8ad484f9792ccca64e542e62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Creating volume b6b99600-0610-4f2a-8d83-3c8c70bef77f {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:17:53 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:17:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:54 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f 1073741824 Jun 11 05:17:54 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0236d1f0-5616-4d65-81f1-04614b8735ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b6233e-e5d8-4e3a-9485-11e395763938', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4fc322-1eec-49e9-9a3e-af96ca3aa23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:54 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Volume volume-74b6233e-e5d8-4e3a-9485-11e395763938 (74b6233e-e5d8-4e3a-9485-11e395763938): created successfully Jun 11 05:17:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4fc322-1eec-49e9-9a3e-af96ca3aa23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Flow 'volume_create_manager' (0e671c22-f5a7-4c41-8037-7944af5fb8a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:54 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e977968d-ead8-412a-9753-dcef8352875e tempest-AttachVolumeTestJSON-196930068 None] Created volume successfully. Jun 11 05:17:54 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a" returned: 0 in 0.815s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:54 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a Jun 11 05:17:54 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:17:55 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (612ae791-11ad-435d-81c0-c121b2bc8d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbba15b8-79a6-41d4-8bff-0bc2b442a44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f 1073741824" returned: 0 in 1.093s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbba15b8-79a6-41d4-8bff-0bc2b442a44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1666341451',display_name='tempest-VolumesGetTest-Volume-1323331734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08f89f0-17a7-42af-9f3b-dba06a906625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949e6955997c486f9e74cd1498379bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:55Z,use_quota=True,user_id='d19de087f6194e1389b3943da4196690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d30433-9d1e-4c72-9bf8-90fcda829204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d30433-9d1e-4c72-9bf8-90fcda829204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f720ee8-1a3e-495f-a376-7fe509722063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f720ee8-1a3e-495f-a376-7fe509722063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c08f89f0-17a7-42af-9f3b-dba06a906625', 'volume_name': 'volume-c08f89f0-17a7-42af-9f3b-dba06a906625', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3aa6dd-87ca-4486-8532-7cf5a3e4b06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3aa6dd-87ca-4486-8532-7cf5a3e4b06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54750160-72ac-405c-b3b9-c3c215d0aa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:55 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Volume c08f89f0-17a7-42af-9f3b-dba06a906625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c08f89f0-17a7-42af-9f3b-dba06a906625', 'volume_size': 1} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:55 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f Jun 11 05:17:55 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:55 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a" returned: 0 in 0.712s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Lock "cinder-quobyte-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a" released by "delete_volume" :: held 1.568s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Created reservations ['356acf21-e8d1-49b1-ad02-ff97622d9a37', '38eddfc4-6b8e-4756-8c24-ed51bcc38959', '66804494-2d35-486e-b9d3-550fdd8586c5', 'e6120caf-db99-446f-96f6-f17202457202'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:55 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:17:55 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:55 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f" returned: 0 in 0.623s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.655s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1666341451',display_name='tempest-VolumesGetTest-Volume-1323331734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08f89f0-17a7-42af-9f3b-dba06a906625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949e6955997c486f9e74cd1498379bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:55Z,use_quota=True,user_id='d19de087f6194e1389b3943da4196690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Creating volume c08f89f0-17a7-42af-9f3b-dba06a906625 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:17:55 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c08f89f0-17a7-42af-9f3b-dba06a906625 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:55 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c08f89f0-17a7-42af-9f3b-dba06a906625 1073741824 Jun 11 05:17:55 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a169daea-f84c-4834-b5de-0061862df107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19eae3b-7366-4966-8d0d-a48751df408a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:55 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Volume volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f (b6b99600-0610-4f2a-8d83-3c8c70bef77f): created successfully Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19eae3b-7366-4966-8d0d-a48751df408a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Flow 'volume_create_manager' (5b3f24cf-adfe-4545-b0b2-ac527ff0eae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:55 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-61504933-7d4e-4c57-b039-a6a6645ae824 tempest-AttachVolumeNegativeTest-1997665377 None] Created volume successfully. Jun 11 05:17:56 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.638s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:17:56 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Deleted volume successfully. Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-570f02cf-9c76-44a5-bfab-74447308f59b tempest-VolumesTransfersV357Test-577929744 None] Lock "cinder-2f5e2d92-0dd2-407e-a4a3-d61b30cd3f3a-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Flow 'volume_create_manager' (19c72ba2-b557-41f7-a0e2-fc4432ee6712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d452e54b-eeb7-41bd-886e-d3555267eb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d452e54b-eeb7-41bd-886e-d3555267eb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1680071745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93958d48-916f-45cc-b67f-4dd8bfadd5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4aa063cfa54f8b922422084ed2801e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:56Z,use_quota=True,user_id='d0a7f5b51ae04390b7f4d8d789c61c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b07d219-1272-4fb2-b403-e4289d9e1e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b07d219-1272-4fb2-b403-e4289d9e1e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f768873-cdb9-4c6e-a39c-059d3d2109c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f768873-cdb9-4c6e-a39c-059d3d2109c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93958d48-916f-45cc-b67f-4dd8bfadd5d2', 'volume_name': 'volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e3acc0-f385-48c5-99bc-706048d074f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e3acc0-f385-48c5-99bc-706048d074f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9965e7-79c9-403a-a0db-d4648b2f1259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:56 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Volume 93958d48-916f-45cc-b67f-4dd8bfadd5d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2', 'volume_size': 1} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:56 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c08f89f0-17a7-42af-9f3b-dba06a906625 1073741824" returned: 0 in 0.916s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c08f89f0-17a7-42af-9f3b-dba06a906625 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:56 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c08f89f0-17a7-42af-9f3b-dba06a906625 Jun 11 05:17:56 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:57 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c08f89f0-17a7-42af-9f3b-dba06a906625" returned: 0 in 0.623s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.756s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1680071745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93958d48-916f-45cc-b67f-4dd8bfadd5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4aa063cfa54f8b922422084ed2801e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:17:56Z,use_quota=True,user_id='d0a7f5b51ae04390b7f4d8d789c61c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Creating volume 93958d48-916f-45cc-b67f-4dd8bfadd5d2 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:17:57 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54750160-72ac-405c-b3b9-c3c215d0aa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08f89f0-17a7-42af-9f3b-dba06a906625', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:57 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2 1073741824 Jun 11 05:17:57 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2506894d-cfad-4fba-86ce-ba0f4acd0a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-00859182-4d02-4967-81c5-f373939a9765 req-e1dd8c0d-b30f-4499-900d-2e3b8c02faf7 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:57 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Volume volume-c08f89f0-17a7-42af-9f3b-dba06a906625 (c08f89f0-17a7-42af-9f3b-dba06a906625): created successfully Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2506894d-cfad-4fba-86ce-ba0f4acd0a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Flow 'volume_create_manager' (612ae791-11ad-435d-81c0-c121b2bc8d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:57 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-743ee70c-a782-46fe-9f64-db92e7d2d257 tempest-VolumesGetTest-2023276017 None] Created volume successfully. Jun 11 05:17:58 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2 1073741824" returned: 0 in 0.778s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:58 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2 Jun 11 05:17:58 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-c08f89f0-17a7-42af-9f3b-dba06a906625-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Lock "cinder-c08f89f0-17a7-42af-9f3b-dba06a906625-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-quobyte-c08f89f0-17a7-42af-9f3b-dba06a906625" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-c08f89f0-17a7-42af-9f3b-dba06a906625" acquired by "delete_volume" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0509d79e-a2de-422b-be26-476ab443fb9c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c08f89f0-17a7-42af-9f3b-dba06a906625 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:58 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c08f89f0-17a7-42af-9f3b-dba06a906625 Jun 11 05:17:58 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:58 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2" returned: 0 in 0.621s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-00859182-4d02-4967-81c5-f373939a9765 req-e1dd8c0d-b30f-4499-900d-2e3b8c02faf7 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.381s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9965e7-79c9-403a-a0db-d4648b2f1259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7617bdb0-086c-4e3f-be4e-bcf41fcd4fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[616d3293-9c66-49a0-bab4-cf741bb2053d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-00859182-4d02-4967-81c5-f373939a9765 req-e1dd8c0d-b30f-4499-900d-2e3b8c02faf7 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:58 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Volume volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2 (93958d48-916f-45cc-b67f-4dd8bfadd5d2): created successfully Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7617bdb0-086c-4e3f-be4e-bcf41fcd4fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:17:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Flow 'volume_create_manager' (19c72ba2-b557-41f7-a0e2-fc4432ee6712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:17:58 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-81660ef8-46d1-4cff-a831-64c7462d7980 tempest-VolumesTransfersV357Test-227941904 None] Created volume successfully. Jun 11 05:17:58 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938 Jun 11 05:17:58 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:59 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c08f89f0-17a7-42af-9f3b-dba06a906625" returned: 0 in 0.761s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c08f89f0-17a7-42af-9f3b-dba06a906625 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:59 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c08f89f0-17a7-42af-9f3b-dba06a906625 Jun 11 05:17:59 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-9975af49-ec28-4511-9ac1-b556227e2e42 req-84e66ed3-1cfb-4334-ab95-83f45618bfcc tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:17:59 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-00859182-4d02-4967-81c5-f373939a9765 req-e1dd8c0d-b30f-4499-900d-2e3b8c02faf7 tempest-AttachVolumeTestJSON-196930068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938" returned: 0 in 0.830s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-00859182-4d02-4967-81c5-f373939a9765 req-e1dd8c0d-b30f-4499-900d-2e3b8c02faf7 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.865s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:17:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-9975af49-ec28-4511-9ac1-b556227e2e42 req-84e66ed3-1cfb-4334-ab95-83f45618bfcc tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.105s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:17:59 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5fb28d-c886-4ac8-838b-016bb32d00f2]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:17:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-9975af49-ec28-4511-9ac1-b556227e2e42 req-84e66ed3-1cfb-4334-ab95-83f45618bfcc tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:17:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-00859182-4d02-4967-81c5-f373939a9765 req-e1dd8c0d-b30f-4499-900d-2e3b8c02faf7 tempest-AttachVolumeTestJSON-196930068 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-74b6233e-e5d8-4e3a-9485-11e395763938', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b788d248-6f73-4a8c-9a44-14d7bc4836e7', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:17:59 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-00859182-4d02-4967-81c5-f373939a9765 req-e1dd8c0d-b30f-4499-900d-2e3b8c02faf7 tempest-AttachVolumeTestJSON-196930068 None] attachment_update completed successfully. Jun 11 05:17:59 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f Jun 11 05:17:59 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:17:59 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Jun 11 05:17:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c08f89f0-17a7-42af-9f3b-dba06a906625" returned: 0 in 0.655s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:17:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-c08f89f0-17a7-42af-9f3b-dba06a906625" released by "delete_volume" :: held 1.468s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:17:59 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Created reservations ['f92dfce7-d484-4102-bd98-68639db1361f', '6dda613b-2cf2-4d68-a553-4e744d7228a1', 'f2fdf611-c1a8-42f4-8de4-1709a520a146', 'abbb3267-32de-4a82-b5f2-98d6eeb1b21b'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:00 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:18:00 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Acquiring lock "cinder-93958d48-916f-45cc-b67f-4dd8bfadd5d2-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Lock "cinder-93958d48-916f-45cc-b67f-4dd8bfadd5d2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Acquiring lock "cinder-quobyte-93958d48-916f-45cc-b67f-4dd8bfadd5d2" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Lock "cinder-quobyte-93958d48-916f-45cc-b67f-4dd8bfadd5d2" acquired by "delete_volume" :: waited 0.024s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:00 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-9975af49-ec28-4511-9ac1-b556227e2e42 req-84e66ed3-1cfb-4334-ab95-83f45618bfcc tempest-AttachVolumeNegativeTest-1997665377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f" returned: 0 in 0.883s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-9975af49-ec28-4511-9ac1-b556227e2e42 req-84e66ed3-1cfb-4334-ab95-83f45618bfcc tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.907s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b897d7a-deca-43c7-a1b0-df17988928a3]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-9975af49-ec28-4511-9ac1-b556227e2e42 req-84e66ed3-1cfb-4334-ab95-83f45618bfcc tempest-AttachVolumeNegativeTest-1997665377 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abed9c26-a50e-42fa-a550-b0b77c98d682', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-cc4eaab3-4196-41ba-97d1-e4e81c8f49be-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Lock "cinder-cc4eaab3-4196-41ba-97d1-e4e81c8f49be-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:00 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-9975af49-ec28-4511-9ac1-b556227e2e42 req-84e66ed3-1cfb-4334-ab95-83f45618bfcc tempest-AttachVolumeNegativeTest-1997665377 None] attachment_update completed successfully. Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Acquiring lock "cinder-quobyte-cc4eaab3-4196-41ba-97d1-e4e81c8f49be" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-cc4eaab3-4196-41ba-97d1-e4e81c8f49be" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:00 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2 Jun 11 05:18:00 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:00 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.779s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:18:00 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Deleted volume successfully. Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-994e5cb0-f522-460d-b6c0-3e55837dea5a tempest-VolumesGetTest-2023276017 None] Lock "cinder-c08f89f0-17a7-42af-9f3b-dba06a906625-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[387c15f3-cb6b-4f92-8341-4d2e269f9452]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:00 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be Jun 11 05:18:00 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:01 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2" returned: 0 in 0.848s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:01 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2 Jun 11 05:18:01 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:01 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be" returned: 0 in 0.739s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:01 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be Jun 11 05:18:01 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:02 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-93958d48-916f-45cc-b67f-4dd8bfadd5d2" returned: 0 in 0.609s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Lock "cinder-quobyte-93958d48-916f-45cc-b67f-4dd8bfadd5d2" released by "delete_volume" :: held 1.512s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Created reservations ['ae68885d-b899-42aa-b654-9aa372f9ee24', '61018d7f-bb59-4d1a-9d64-ae132bc0d559', 'bff30170-f48e-491c-a415-f60d2e3c86c4', 'dd71bb24-a33f-419a-b210-13e67bb1dae7'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:02 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:18:02 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:02 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be" returned: 1 in 0.763s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:02 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be Jun 11 05:18:02 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:02 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.702s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:18:02 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Deleted volume successfully. Jun 11 05:18:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c50d13fc-a461-4e75-87f4-78e104a9a5fe tempest-VolumesTransfersV357Test-577929744 None] Lock "cinder-93958d48-916f-45cc-b67f-4dd8bfadd5d2-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:03 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cc4eaab3-4196-41ba-97d1-e4e81c8f49be" returned: 0 in 0.660s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:03 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Lock "cinder-quobyte-cc4eaab3-4196-41ba-97d1-e4e81c8f49be" released by "delete_volume" :: held 2.263s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:03 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Created reservations ['5c2b2518-832c-47e4-b52c-6c8aabf0b2e4', '3b98af46-e03d-4176-b14d-0fa5d82ef1c9', '7b8d9ecd-695a-47a1-9bb5-073c9aafd1a0', 'ee0c1d06-7ea4-4b10-ae6d-9325554767be'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:18:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:03 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:18:03 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:03 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.710s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:03 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:18:03 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Deleted volume successfully. Jun 11 05:18:03 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-be2dd622-1ccd-4f8e-9fad-fd171d17db4f tempest-VolumesGetTest-2023276017 None] Lock "cinder-cc4eaab3-4196-41ba-97d1-e4e81c8f49be-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:05 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-a2ea2e2d-259a-4e70-9608-492c8585c023 req-ce0c27c3-fbe6-4866-a170-55837de99afc tempest-AttachVolumeTestJSON-196930068 None] Terminate volume connection completed successfully. Jun 11 05:18:05 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-a2ea2e2d-259a-4e70-9608-492c8585c023 req-ce0c27c3-fbe6-4866-a170-55837de99afc tempest-AttachVolumeTestJSON-196930068 None] Deleting attachment 5ebe1ba2-ee58-465a-a7d7-de8ba4d2c16c. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:18:08 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-440a6e16-06dc-4387-a7b1-60b6e6acd436 req-1a97b5cf-f5d5-4d10-97c4-75a4e3b6602e tempest-AttachVolumeTestJSON-196930068 None] Terminate volume connection completed successfully. Jun 11 05:18:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-440a6e16-06dc-4387-a7b1-60b6e6acd436 req-1a97b5cf-f5d5-4d10-97c4-75a4e3b6602e tempest-AttachVolumeTestJSON-196930068 None] Deleting attachment b788d248-6f73-4a8c-9a44-14d7bc4836e7. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:18:09 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:18:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Flow 'volume_create_manager' (7d91fe8f-d9d6-42be-874f-cfa797c1de99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:18:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d98c726-77a7-4f6c-80dc-07a445b40c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d98c726-77a7-4f6c-80dc-07a445b40c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-85117993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0d3e56-d182-4e7b-8fad-df245f18d784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56938c4c59e345fcbf45cfe3dbf4fe0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:18:10Z,use_quota=True,user_id='06261336ae8c4817a8d5afd923610e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e3778e-dee2-4d34-9259-963960d1bcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e3778e-dee2-4d34-9259-963960d1bcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507d3ba6-68da-49cb-9f47-606532eeb317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:09 devstack cinder-volume[92308]: DEBUG cinder.image.glance [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Creating Keystone auth plugin from conf {{(pid=92308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 11 05:18:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507d3ba6-68da-49cb-9f47-606532eeb317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba0d3e56-d182-4e7b-8fad-df245f18d784', 'volume_name': 'volume-ba0d3e56-d182-4e7b-8fad-df245f18d784', 'volume_size': 1, 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fc36ed7ee404444980e7b3d4d23270a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'created_at': datetime.datetime(2026, 6, 11, 3, 3, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 3, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5948caf3-a8c7-4db4-a99d-12690a647bd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71fbfa8-fa02-43a2-aa8f-28886687345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71fbfa8-fa02-43a2-aa8f-28886687345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40689879-6583-49e6-a7bc-832f04461207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:09 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Volume ba0d3e56-d182-4e7b-8fad-df245f18d784: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba0d3e56-d182-4e7b-8fad-df245f18d784', 'volume_size': 1, 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fc36ed7ee404444980e7b3d4d23270a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'created_at': datetime.datetime(2026, 6, 11, 3, 3, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 3, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5948caf3-a8c7-4db4-a99d-12690a647bd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 11 05:18:09 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Trying to clone ba0d3e56-d182-4e7b-8fad-df245f18d784 from image 5948caf3-a8c7-4db4-a99d-12690a647bd4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]). {{(pid=92308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 11 05:18:10 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 11 05:18:10 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Image download 20.69 MB at 20.69 MB/s Jun 11 05:18:10 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1568523e-2229-4c91-a59d-2cba4abf7891]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:10 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD Jun 11 05:18:10 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:11 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD" returned: 0 in 0.835s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Temporary image 5948caf3-a8c7-4db4-a99d-12690a647bd4 is fetched for user 06261336ae8c4817a8d5afd923610e54. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e32cf56-ef46-4976-a0e0-5e827c88d927]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:11 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD Jun 11 05:18:11 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:11 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD" returned: 0 in 0.749s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-85117993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0d3e56-d182-4e7b-8fad-df245f18d784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56938c4c59e345fcbf45cfe3dbf4fe0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:18:10Z,use_quota=True,user_id='06261336ae8c4817a8d5afd923610e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Creating volume ba0d3e56-d182-4e7b-8fad-df245f18d784 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:18:11 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:18:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:12 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 1073741824 Jun 11 05:18:12 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:13 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 1073741824" returned: 0 in 1.157s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:13 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 Jun 11 05:18:13 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:13 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784" returned: 0 in 0.713s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:18:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:13 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Attempting download of 5948caf3-a8c7-4db4-a99d-12690a647bd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}])) to volume ba0d3e56-d182-4e7b-8fad-df245f18d784. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 11 05:18:13 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce160f03-e961-4cee-bb39-909a32c81480]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_p5eyoo57 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:14 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_p5eyoo57 Jun 11 05:18:14 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:14 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_p5eyoo57" returned: 0 in 0.850s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_p5eyoo57 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:14 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_p5eyoo57 Jun 11 05:18:14 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:15 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_p5eyoo57" returned: 1 in 0.826s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_p5eyoo57' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:18:15 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[923b6f5e-4cbb-410f-be96-6e5311b9a72d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:15 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD Jun 11 05:18:15 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:16 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD" returned: 0 in 0.784s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:16 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] 5948caf3-a8c7-4db4-a99d-12690a647bd4 was qcow2, converting to raw {{(pid=92308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 11 05:18:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:16 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 Jun 11 05:18:16 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:18 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784" returned: 0 in 2.381s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:18 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_6f3j84h4devstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:18:18 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Converted 112.00 MB image at 47.02 MB/s Jun 11 05:18:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:18 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 1G Jun 11 05:18:18 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:18:19 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Flow 'volume_create_manager' (3846aa94-9232-4381-8f78-a9f510cf0513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf2dcd9-b4fd-4927-9986-5b48f96c39a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 1G" returned: 0 in 0.848s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf2dcd9-b4fd-4927-9986-5b48f96c39a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1629715957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a6c188-d2cf-4158-aaf8-4df3b8ecec37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ff26ce106045be8624ca87fe445e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:18:20Z,use_quota=True,user_id='17ecdde41f9d40d18e602c29668b610c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f5293b-4cd9-459d-a09f-822011d36a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f5293b-4cd9-459d-a09f-822011d36a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb99d3a3-70b5-4f67-963e-113533815ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb99d3a3-70b5-4f67-963e-113533815ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a6c188-d2cf-4158-aaf8-4df3b8ecec37', 'volume_name': 'volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0a559a-aa77-42a2-8678-bfd54921d2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0a559a-aa77-42a2-8678-bfd54921d2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f26d62-70e5-4013-b27b-f3a093a9db6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:19 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Volume b1a6c188-d2cf-4158-aaf8-4df3b8ecec37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37', 'volume_size': 1} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1629715957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a6c188-d2cf-4158-aaf8-4df3b8ecec37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ff26ce106045be8624ca87fe445e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:18:20Z,use_quota=True,user_id='17ecdde41f9d40d18e602c29668b610c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Creating volume b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:18:19 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4f5766-dea3-4d58-9279-fbf7db938ae2]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:19 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 1073741824 Jun 11 05:18:19 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:19 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 Jun 11 05:18:19 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:20 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784" returned: 0 in 0.761s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:20 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 1073741824" returned: 0 in 0.859s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:20 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 Jun 11 05:18:20 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:20 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 Jun 11 05:18:20 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:21 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784" returned: 1 in 0.875s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:18:21 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Downloaded image 5948caf3-a8c7-4db4-a99d-12690a647bd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}])) to volume ba0d3e56-d182-4e7b-8fad-df245f18d784 successfully. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Temporary image 5948caf3-a8c7-4db4-a99d-12690a647bd4 for user 06261336ae8c4817a8d5afd923610e54 is deleted. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Marking volume ba0d3e56-d182-4e7b-8fad-df245f18d784 as bootable. {{(pid=92308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37" returned: 0 in 0.780s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f26d62-70e5-4013-b27b-f3a093a9db6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb9d0ed-1e87-4112-92e3-3e0374ff448f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Copying metadata from image 5948caf3-a8c7-4db4-a99d-12690a647bd4 to ba0d3e56-d182-4e7b-8fad-df245f18d784. {{(pid=92308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Creating volume glance metadata for volume ba0d3e56-d182-4e7b-8fad-df245f18d784 backed by image 5948caf3-a8c7-4db4-a99d-12690a647bd4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 11 05:18:21 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Volume volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 (b1a6c188-d2cf-4158-aaf8-4df3b8ecec37): created successfully Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb9d0ed-1e87-4112-92e3-3e0374ff448f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Flow 'volume_create_manager' (3846aa94-9232-4381-8f78-a9f510cf0513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:18:21 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0e5b94f5-1a9e-421d-9a5e-18dede4e04f2 tempest-VolumesSnapshotTestJSON-26480945 None] Created volume successfully. Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40689879-6583-49e6-a7bc-832f04461207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba0d3e56-d182-4e7b-8fad-df245f18d784', 'volume_size': 1, 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fc36ed7ee404444980e7b3d4d23270a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'created_at': datetime.datetime(2026, 6, 11, 3, 3, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 3, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5948caf3-a8c7-4db4-a99d-12690a647bd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf2a848-d53d-4555-a7d1-6ac19be27744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:21 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Volume volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 (ba0d3e56-d182-4e7b-8fad-df245f18d784): created successfully Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf2a848-d53d-4555-a7d1-6ac19be27744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Flow 'volume_create_manager' (7d91fe8f-d9d6-42be-874f-cfa797c1de99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:18:21 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b1ca4de5-b2ee-4119-add5-ee7f36cf4762 tempest-VolumesExtendTest-421989206 None] Created volume successfully. Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] Creating offline snapshot cef4db51-809c-4e15-bb33-7b0f6553ed02 of volume b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:18:22 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[de10d1ca-58b4-450b-8ae1-1c857bc8e981]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:22 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "cinder-74b6233e-e5d8-4e3a-9485-11e395763938-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:22 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Lock "cinder-74b6233e-e5d8-4e3a-9485-11e395763938-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:22 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "cinder-quobyte-74b6233e-e5d8-4e3a-9485-11e395763938" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:22 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Lock "cinder-quobyte-74b6233e-e5d8-4e3a-9485-11e395763938" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:22 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e72215-2956-42ce-b642-2555f71f9b6b]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:22 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 Jun 11 05:18:22 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:22 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938 Jun 11 05:18:22 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6f69f6ba-248b-4521-9075-eb457acb50a2 tempest-VolumesExtendTest-421989206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:22 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37" returned: 0 in 0.823s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:22 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 1G Jun 11 05:18:22 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:23 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938" returned: 0 in 0.922s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:23 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938 Jun 11 05:18:23 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:23 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-74b6233e-e5d8-4e3a-9485-11e395763938" returned: 0 in 0.728s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Lock "cinder-quobyte-74b6233e-e5d8-4e3a-9485-11e395763938" released by "delete_volume" :: held 1.700s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:23 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=105,cinder:SELECT=109,cinder:INSERT=31,cinder:DELETE=10 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:18:23 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=104,cinder:UPDATE=134,cinder:INSERT=44,cinder:DELETE=12 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:18:23 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Created reservations ['9a521c7f-6cf3-46c1-82e9-ca122b8ce0ff', 'c9fa7182-8138-4705-b8bd-8dc472d84a20', 'c56e6183-83dc-4eb6-b97c-7bfd25257ae5', '58394a55-d57b-4e33-979d-02739e279166'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:18:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:23 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:18:23 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:24 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 1G" returned: 0 in 1.179s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:24 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 Jun 11 05:18:24 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "cinder-d5ccd656-42cb-4240-920c-cc14eda5ac27-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Lock "cinder-d5ccd656-42cb-4240-920c-cc14eda5ac27-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "cinder-quobyte-d5ccd656-42cb-4240-920c-cc14eda5ac27" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Lock "cinder-quobyte-d5ccd656-42cb-4240-920c-cc14eda5ac27" acquired by "delete_volume" :: waited 0.030s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:24 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0537ae-4d57-4b1c-b27d-0cb16a2a8cd0]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:24 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27 Jun 11 05:18:24 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:24 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.784s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:24 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:18:24 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Deleted volume successfully. Jun 11 05:18:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fc27905f-a978-4396-9d25-a6fbb0a62d11 tempest-AttachVolumeTestJSON-196930068 None] Lock "cinder-74b6233e-e5d8-4e3a-9485-11e395763938-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:24 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02" returned: 0 in 0.941s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:24 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 is being set with open permissions: ugo+rw Jun 11 05:18:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:24 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 Jun 11 05:18:24 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:25 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27" returned: 0 in 0.925s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:25 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27 Jun 11 05:18:25 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:25 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02" returned: 0 in 0.761s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:25 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.info Jun 11 05:18:25 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:26 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d5ccd656-42cb-4240-920c-cc14eda5ac27" returned: 0 in 0.678s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Lock "cinder-quobyte-d5ccd656-42cb-4240-920c-cc14eda5ac27" released by "delete_volume" :: held 1.698s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:26 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Created reservations ['55a8ca93-49ee-4604-9d5d-d6980c964866', 'dff585f8-1e45-4c60-9e48-091cea670293', 'a5cb86e0-d220-47d2-aae9-9ad00121b553', '76a01f15-49d8-4051-a957-e1c05bf62204'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:18:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:26 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:18:26 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:26 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.info" returned: 0 in 0.647s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:26 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.info is being set with open permissions: ugo+rw Jun 11 05:18:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:26 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.info Jun 11 05:18:26 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "cinder-ec495eb9-0a96-417d-8235-4b1d60f4c0b5-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Lock "cinder-ec495eb9-0a96-417d-8235-4b1d60f4c0b5-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "cinder-quobyte-ec495eb9-0a96-417d-8235-4b1d60f4c0b5" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Lock "cinder-quobyte-ec495eb9-0a96-417d-8235-4b1d60f4c0b5" acquired by "delete_volume" :: waited 0.042s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:27 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad05a29-a132-433f-af29-c91808b22781]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:27 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.950s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:27 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:18:27 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Deleted volume successfully. Jun 11 05:18:27 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.info" returned: 0 in 0.885s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.345s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6f69f6ba-248b-4521-9075-eb457acb50a2 tempest-VolumesExtendTest-421989206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.575s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-bbfb185a-0e02-4a87-b3a6-77291e52ca99 tempest-AttachVolumeTestJSON-196930068 None] Lock "cinder-d5ccd656-42cb-4240-920c-cc14eda5ac27-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:27 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5 Jun 11 05:18:27 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:27 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6482836b-ab1c-47a0-b873-c81f799a4cae]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f69f6ba-248b-4521-9075-eb457acb50a2 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:27 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0882f977-f170-48f0-b0e8-318eeeb9c30d tempest-VolumesSnapshotTestJSON-26480945 None] Create snapshot completed successfully Jun 11 05:18:27 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 Jun 11 05:18:27 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:28 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5" returned: 0 in 0.982s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:28 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5 Jun 11 05:18:28 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:28 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f69f6ba-248b-4521-9075-eb457acb50a2 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784" returned: 0 in 0.911s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f69f6ba-248b-4521-9075-eb457acb50a2 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:28 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 Jun 11 05:18:28 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-cef4db51-809c-4e15-bb33-7b0f6553ed02-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-cef4db51-809c-4e15-bb33-7b0f6553ed02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37" acquired by "delete_snapshot" :: waited 0.032s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-cef4db51-809c-4e15-bb33-7b0f6553ed02" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-cef4db51-809c-4e15-bb33-7b0f6553ed02" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Deleting offline snapshot cef4db51-809c-4e15-bb33-7b0f6553ed02 of volume b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] snapshot_file for this snap is: volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c234467-146e-4066-84b1-88388b2d94b8]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:29 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ec495eb9-0a96-417d-8235-4b1d60f4c0b5" returned: 0 in 0.853s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Lock "cinder-quobyte-ec495eb9-0a96-417d-8235-4b1d60f4c0b5" released by "delete_volume" :: held 1.954s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:29 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 Jun 11 05:18:29 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Created reservations ['b92fb88f-610d-4b57-ae2e-9842c5921060', '63f86479-87e0-4485-923f-eae41719ad15', 'cf17a272-ed33-4880-8a34-febb440962d1', '37e3ad22-a77c-4d3d-8f6e-8647940602e3'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:29 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:18:29 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:29 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f69f6ba-248b-4521-9075-eb457acb50a2 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784" returned: 1 in 1.061s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f69f6ba-248b-4521-9075-eb457acb50a2 tempest-VolumesExtendTest-421989206 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f69f6ba-248b-4521-9075-eb457acb50a2 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 2G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f69f6ba-248b-4521-9075-eb457acb50a2 tempest-VolumesExtendTest-421989206 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 2G" returned: 0 in 0.173s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6f69f6ba-248b-4521-9075-eb457acb50a2 tempest-VolumesExtendTest-421989206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.232s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:29 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-6f69f6ba-248b-4521-9075-eb457acb50a2 tempest-VolumesExtendTest-421989206 None] Extend volume completed successfully. Jun 11 05:18:30 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02" returned: 0 in 1.195s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1bdfb2-71b4-49bf-8d1c-c80ac469a95d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:30 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.075s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:18:30 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Deleted volume successfully. Jun 11 05:18:30 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:18:30 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:30 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 Jun 11 05:18:30 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b755db36-fd88-4b0c-a562-46c5a11aa4c5 tempest-AttachVolumeTestJSON-196930068 None] Lock "cinder-ec495eb9-0a96-417d-8235-4b1d60f4c0b5-delete_volume" released by "delete_volume" :: held 3.421s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Acquiring lock "cinder-ba0d3e56-d182-4e7b-8fad-df245f18d784-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Lock "cinder-ba0d3e56-d182-4e7b-8fad-df245f18d784-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:30 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Acquiring lock "cinder-quobyte-ba0d3e56-d182-4e7b-8fad-df245f18d784" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Lock "cinder-quobyte-ba0d3e56-d182-4e7b-8fad-df245f18d784" acquired by "delete_volume" :: waited 0.031s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:31 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[638d6190-4623-4431-bb16-e6136068bb4b]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:31 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.968s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:18:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:18:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:18:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:18:31 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 Jun 11 05:18:31 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:31 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37" returned: 0 in 1.266s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:31 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 Jun 11 05:18:31 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:32 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784" returned: 0 in 0.939s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:32 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 Jun 11 05:18:32 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:32 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02" returned: 0 in 1.037s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:32 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02 Jun 11 05:18:32 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:32 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784" returned: 1 in 0.871s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:18:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:32 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784 Jun 11 05:18:32 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:33 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37.cef4db51-809c-4e15-bb33-7b0f6553ed02" returned: 0 in 0.837s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-cef4db51-809c-4e15-bb33-7b0f6553ed02" released by "_delete_snapshot" :: held 4.488s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37" released by "delete_snapshot" :: held 4.528s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Created reservations ['c52d4939-dee6-403a-a0bc-bc6ad85f995e', '085bb34b-d848-48b7-b445-2bbb992bb47b', '59cd7832-c5e2-4a84-9fd3-6655a4585127', '7f1fe851-272b-4fc5-aa21-6e202353b13b'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:18:33 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Delete snapshot completed successfully. Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6b355599-1c9d-43d2-a263-a2394464f240 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-cef4db51-809c-4e15-bb33-7b0f6553ed02-delete_snapshot" released by "delete_snapshot" :: held 4.950s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:33 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ba0d3e56-d182-4e7b-8fad-df245f18d784" returned: 0 in 0.947s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Lock "cinder-quobyte-ba0d3e56-d182-4e7b-8fad-df245f18d784" released by "delete_volume" :: held 2.852s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Created reservations ['ed6ddbfb-75b2-4c09-864b-bf1467ed75b9', 'ea1e23d4-98f7-48c7-8374-63ff0907c948', '74d0d459-82ca-4bdb-bf90-494f6e085892', 'b1889449-268d-4a8a-a5a8-298625a87f25'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:34 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:18:34 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:34 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.834s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:34 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:18:34 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Deleted volume successfully. Jun 11 05:18:34 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5ccfbb12-fe78-4adb-9c53-2f011658ffe8 tempest-VolumesExtendTest-421989206 None] Lock "cinder-ba0d3e56-d182-4e7b-8fad-df245f18d784-delete_volume" released by "delete_volume" :: held 4.028s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Flow 'volume_create_manager' (2c869a83-8ee3-4c63-9fe2-4cb91e638fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f88c12-7738-48b5-85d3-d90fb15695c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f88c12-7738-48b5-85d3-d90fb15695c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1749406005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36956579-06b9-42e9-9e5e-26517643fe00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ff26ce106045be8624ca87fe445e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:18:35Z,use_quota=True,user_id='17ecdde41f9d40d18e602c29668b610c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac7abdc-8b1f-4bda-a271-cf9d7e82780b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac7abdc-8b1f-4bda-a271-cf9d7e82780b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a3b8c8-8a69-4082-a5bb-7a0ab03b81b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a3b8c8-8a69-4082-a5bb-7a0ab03b81b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36956579-06b9-42e9-9e5e-26517643fe00', 'volume_name': 'volume-36956579-06b9-42e9-9e5e-26517643fe00', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82105ab-b445-48d9-af08-995705a82162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82105ab-b445-48d9-af08-995705a82162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e060beeb-0e5b-4f03-87eb-7ab8e481038a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:35 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Volume 36956579-06b9-42e9-9e5e-26517643fe00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36956579-06b9-42e9-9e5e-26517643fe00', 'volume_size': 1} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1749406005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36956579-06b9-42e9-9e5e-26517643fe00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ff26ce106045be8624ca87fe445e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:18:35Z,use_quota=True,user_id='17ecdde41f9d40d18e602c29668b610c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Creating volume 36956579-06b9-42e9-9e5e-26517643fe00 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:18:35 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:35 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 1073741824 Jun 11 05:18:35 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Flow 'volume_create_manager' (d6609eee-1d76-46cf-a642-a2837eaaf864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd71fa97-0930-43d0-9f9d-2396c4380d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd71fa97-0930-43d0-9f9d-2396c4380d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1556152879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779aba8d-f8b1-4954-92d7-128d723747fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56938c4c59e345fcbf45cfe3dbf4fe0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:18:35Z,use_quota=True,user_id='06261336ae8c4817a8d5afd923610e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eacdd1a-2e37-4f13-b106-a1bc7ccf8a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eacdd1a-2e37-4f13-b106-a1bc7ccf8a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4e8e3c-74ad-40ac-a0f6-88bd3e209703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4e8e3c-74ad-40ac-a0f6-88bd3e209703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '779aba8d-f8b1-4954-92d7-128d723747fd', 'volume_name': 'volume-779aba8d-f8b1-4954-92d7-128d723747fd', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df1fe7d-c13f-423f-a8fb-9397218af0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df1fe7d-c13f-423f-a8fb-9397218af0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad273b5e-558d-4ddb-8564-f241b9d1a807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:35 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Volume 779aba8d-f8b1-4954-92d7-128d723747fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-779aba8d-f8b1-4954-92d7-128d723747fd', 'volume_size': 1} Jun 11 05:18:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:36 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 1073741824" returned: 0 in 0.940s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:36 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 Jun 11 05:18:36 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:36 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00" returned: 0 in 0.731s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.474s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1556152879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779aba8d-f8b1-4954-92d7-128d723747fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56938c4c59e345fcbf45cfe3dbf4fe0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:18:35Z,use_quota=True,user_id='06261336ae8c4817a8d5afd923610e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Creating volume 779aba8d-f8b1-4954-92d7-128d723747fd {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:18:36 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e060beeb-0e5b-4f03-87eb-7ab8e481038a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36956579-06b9-42e9-9e5e-26517643fe00', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:36 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd 1073741824 Jun 11 05:18:36 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45156017-d8d1-4bec-9841-30064d8743e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:36 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Volume volume-36956579-06b9-42e9-9e5e-26517643fe00 (36956579-06b9-42e9-9e5e-26517643fe00): created successfully Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45156017-d8d1-4bec-9841-30064d8743e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Flow 'volume_create_manager' (2c869a83-8ee3-4c63-9fe2-4cb91e638fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:18:37 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e723f866-4038-4ebc-ac23-3122101c3f0f tempest-VolumesSnapshotTestJSON-26480945 None] Created volume successfully. Jun 11 05:18:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:37 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd 1073741824" returned: 0 in 0.875s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:37 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd Jun 11 05:18:37 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:38 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd" returned: 0 in 0.613s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:18:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.076s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad273b5e-558d-4ddb-8564-f241b9d1a807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779aba8d-f8b1-4954-92d7-128d723747fd', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130a4705-3502-427f-83f5-9bf5f1eac5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] Creating offline snapshot 8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 of volume 36956579-06b9-42e9-9e5e-26517643fe00 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:18:38 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Volume volume-779aba8d-f8b1-4954-92d7-128d723747fd (779aba8d-f8b1-4954-92d7-128d723747fd): created successfully Jun 11 05:18:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130a4705-3502-427f-83f5-9bf5f1eac5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Flow 'volume_create_manager' (d6609eee-1d76-46cf-a642-a2837eaaf864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:18:38 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f932e5-6bb9-47da-9292-4a83209b64b0]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:38 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-365b8c1e-e223-4430-b615-fbcc50ff00e4 tempest-VolumesExtendTest-421989206 None] Created volume successfully. Jun 11 05:18:38 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 Jun 11 05:18:38 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:39 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00" returned: 0 in 0.754s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:39 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 1G Jun 11 05:18:39 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:40 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 1G" returned: 0 in 0.842s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36956579-06b9-42e9-9e5e-26517643fe00 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:40 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36956579-06b9-42e9-9e5e-26517643fe00 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 Jun 11 05:18:40 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:40 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36956579-06b9-42e9-9e5e-26517643fe00 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452" returned: 0 in 0.652s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:40 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 is being set with open permissions: ugo+rw Jun 11 05:18:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:40 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 Jun 11 05:18:40 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:41 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452" returned: 0 in 0.592s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:41 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.info Jun 11 05:18:41 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:41 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.info" returned: 0 in 0.607s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:41 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.info is being set with open permissions: ugo+rw Jun 11 05:18:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:42 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.info Jun 11 05:18:42 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:42 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.info" returned: 0 in 0.594s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.159s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.720s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] Creating offline snapshot 563c9495-ab9b-4d9c-ae79-9f8c2372d273 of volume 779aba8d-f8b1-4954-92d7-128d723747fd {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:18:42 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed58d18-f3ac-463a-8cb7-34e396c5b7e9]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:42 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-ff7eb270-4767-4722-b76e-262cc3147255 tempest-VolumesSnapshotTestJSON-26480945 None] Create snapshot completed successfully Jun 11 05:18:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-42a81185-e495-410e-b47e-a7f088033857 tempest-BackendsCapabilitiesAdminTestsJSON-848590622 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92308) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 11 05:18:42 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd Jun 11 05:18:42 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-472f29b7-cd87-4ad0-8758-ceb1a6b1cbd1 tempest-BackendsCapabilitiesAdminTestsJSON-848590622 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92308) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 11 05:18:43 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd" returned: 0 in 0.750s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:43 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 1G Jun 11 05:18:43 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:18:44 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 1G" returned: 0 in 1.006s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-779aba8d-f8b1-4954-92d7-128d723747fd -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:44 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-779aba8d-f8b1-4954-92d7-128d723747fd -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Flow 'volume_create_manager' (b2050bc2-86da-464a-89b4-35090514582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:18:44 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f52ca4-8a2d-45fc-8d1e-b23504ac9109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f52ca4-8a2d-45fc-8d1e-b23504ac9109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1226865463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5529808-8e4c-4a6a-b14c-47c1a784f9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ff26ce106045be8624ca87fe445e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:18:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8ea8f685-38db-4cf5-bdc8-2c4a8cdce452,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:18:44Z,use_quota=True,user_id='17ecdde41f9d40d18e602c29668b610c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174fb681-84fc-420f-b152-20c33155a73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174fb681-84fc-420f-b152-20c33155a73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4988de61-2dcf-41ae-bc50-ded56d03fb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4988de61-2dcf-41ae-bc50-ded56d03fb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f5529808-8e4c-4a6a-b14c-47c1a784f9f0', 'volume_name': 'volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0', 'volume_size': 2, 'snapshot_id': '8ea8f685-38db-4cf5-bdc8-2c4a8cdce452'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16628f5d-e509-4a78-8b09-3e26115c4a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16628f5d-e509-4a78-8b09-3e26115c4a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7914de1d-1af7-48b1-ac81-60785cd90721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:44 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Volume f5529808-8e4c-4a6a-b14c-47c1a784f9f0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0', 'volume_size': 2, 'snapshot_id': '8ea8f685-38db-4cf5-bdc8-2c4a8cdce452'} Jun 11 05:18:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:45 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-779aba8d-f8b1-4954-92d7-128d723747fd -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273" returned: 0 in 0.745s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:45 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 is being set with open permissions: ugo+rw Jun 11 05:18:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:45 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 Jun 11 05:18:45 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:45 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273" returned: 0 in 0.821s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:46 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.info Jun 11 05:18:46 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:46 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.info" returned: 0 in 0.734s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:46 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.info is being set with open permissions: ugo+rw Jun 11 05:18:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:46 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.info Jun 11 05:18:46 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:47 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.info" returned: 0 in 0.624s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.778s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.865s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-8ea8f685-38db-4cf5-bdc8-2c4a8cdce452-f5529808-8e4c-4a6a-b14c-47c1a784f9f0" by "_create_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-8ea8f685-38db-4cf5-bdc8-2c4a8cdce452-f5529808-8e4c-4a6a-b14c-47c1a784f9f0" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Creating volume f5529808-8e4c-4a6a-b14c-47c1a784f9f0 from snapshot 8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 {{(pid=92308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-f5529808-8e4c-4a6a-b14c-47c1a784f9f0" by "_copy_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:47 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-cd137b60-6ed3-415c-9c40-62a30b29cf2e tempest-VolumesExtendTest-421989206 None] Create snapshot completed successfully Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-f5529808-8e4c-4a6a-b14c-47c1a784f9f0" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] snapshot: 8ea8f685-38db-4cf5-bdc8-2c4a8cdce452, volume: f5529808-8e4c-4a6a-b14c-47c1a784f9f0, {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d8bcd9-cc24-4034-b401-1d95650f962e]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:47 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 Jun 11 05:18:47 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:48 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452" returned: 0 in 0.747s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36956579-06b9-42e9-9e5e-26517643fe00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:18:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] will copy from snapshot at /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 11 05:18:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Creating direct copy from snapshot {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 11 05:18:48 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2424f220-1683-4a7b-b300-97e2a445c6ea]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-572da703-a7d2-4152-aaf5-bedc47290d53 tempest-VolumesExtendTest-421989206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:48 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 Jun 11 05:18:48 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:49 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00" returned: 0 in 0.802s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:49 devstack cinder-volume[92308]: DEBUG cinder.utils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Path /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0 not found in is_blk_device check {{(pid=92308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 11 05:18:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:49 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0 Jun 11 05:18:49 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-814f123f-c133-41d8-8b7e-5d8c74deeed6 tempest-GroupsV314Test-1231828751 None] Group tempest-GroupsV314Test-Group-263208802: creating Jun 11 05:18:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-814f123f-c133-41d8-8b7e-5d8c74deeed6 tempest-GroupsV314Test-1231828751 None] Group tempest-GroupsV314Test-Group-263208802: created successfully Jun 11 05:18:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-814f123f-c133-41d8-8b7e-5d8c74deeed6 tempest-GroupsV314Test-1231828751 None] Create group completed successfully. Jun 11 05:18:51 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:18:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Flow 'volume_create_manager' (f12144e3-fd90-413c-a297-f8301d4a91bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:18:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a06550-28c9-4982-b4d5-c74b415e4720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a06550-28c9-4982-b4d5-c74b415e4720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1724457442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b9eae49-103d-4982-9a5a-b8cdfc65c047,host='devstack@QuobyteHD#QuobyteHD',id=1ec59025-687e-45ef-bfa9-ffc0613f1fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a94d4a58e84b2695551f3b8ea5c47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:18:51Z,use_quota=True,user_id='5fda557d13cc4ea6a9791198c5507c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2756146a-82f2-4359-b87f-a7e6014b1bb4),volume_type_id=2756146a-82f2-4359-b87f-a7e6014b1bb4)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d9641b-8bfa-4504-9eb4-1d6997dd7c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d9641b-8bfa-4504-9eb4-1d6997dd7c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c099e001-7496-499d-a1a5-d0cfc3815709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c099e001-7496-499d-a1a5-d0cfc3815709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec59025-687e-45ef-bfa9-ffc0613f1fc3', 'volume_name': 'volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c57c7f3-c040-4143-acc5-0475446c3496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c57c7f3-c040-4143-acc5-0475446c3496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6865d3-4a70-4ef4-ae93-0029d2f5a8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:51 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Volume 1ec59025-687e-45ef-bfa9-ffc0613f1fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3', 'volume_size': 1} Jun 11 05:18:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:55 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0" returned: 0 in 5.945s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:55 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdcb816-2d91-4530-95bb-fc36283d4fe3]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:55 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 Jun 11 05:18:55 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:55 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00" returned: 0 in 0.883s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:55 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0 {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:18:55 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Converted 1024.00 MB image at 172.22 MB/s Jun 11 05:18:55 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0 is being set with open permissions: ugo+rw Jun 11 05:18:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:55 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0 Jun 11 05:18:55 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:56 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0" returned: 0 in 0.581s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:56 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-f5529808-8e4c-4a6a-b14c-47c1a784f9f0" released by "_copy_volume_from_snapshot" :: held 9.075s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:56 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-8ea8f685-38db-4cf5-bdc8-2c4a8cdce452-f5529808-8e4c-4a6a-b14c-47c1a784f9f0" released by "_create_volume_from_snapshot" :: held 9.116s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.149s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-572da703-a7d2-4152-aaf5-bedc47290d53 tempest-VolumesExtendTest-421989206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 8.153s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:56 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeabc44-14c9-472a-acd7-037b23bd4927]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-572da703-a7d2-4152-aaf5-bedc47290d53 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7914de1d-1af7-48b1-ac81-60785cd90721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0', 'volume_size': 2, 'snapshot_id': '8ea8f685-38db-4cf5-bdc8-2c4a8cdce452'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e9f0df-b1ac-49ea-8e23-6842537d3038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:56 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Volume volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0 (f5529808-8e4c-4a6a-b14c-47c1a784f9f0): created successfully Jun 11 05:18:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e9f0df-b1ac-49ea-8e23-6842537d3038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Flow 'volume_create_manager' (b2050bc2-86da-464a-89b4-35090514582a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:18:56 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a583925a-fc41-4e66-ace1-e5bcedd233cb tempest-VolumesSnapshotTestJSON-26480945 None] Created volume successfully. Jun 11 05:18:56 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd Jun 11 05:18:56 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:57 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-572da703-a7d2-4152-aaf5-bedc47290d53 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd" returned: 0 in 0.704s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-572da703-a7d2-4152-aaf5-bedc47290d53 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 2G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-572da703-a7d2-4152-aaf5-bedc47290d53 tempest-VolumesExtendTest-421989206 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 2G" returned: 0 in 0.186s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-572da703-a7d2-4152-aaf5-bedc47290d53 tempest-VolumesExtendTest-421989206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.938s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.707s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5b9eae49-103d-4982-9a5a-b8cdfc65c047,created_at=2026-06-11T03:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1724457442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b9eae49-103d-4982-9a5a-b8cdfc65c047,host='devstack@QuobyteHD#QuobyteHD',id=1ec59025-687e-45ef-bfa9-ffc0613f1fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a94d4a58e84b2695551f3b8ea5c47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:18:51Z,use_quota=True,user_id='5fda557d13cc4ea6a9791198c5507c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2756146a-82f2-4359-b87f-a7e6014b1bb4),volume_type_id=2756146a-82f2-4359-b87f-a7e6014b1bb4)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Creating volume 1ec59025-687e-45ef-bfa9-ffc0613f1fc3 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:18:57 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:57 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 1073741824 Jun 11 05:18:57 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:57 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-572da703-a7d2-4152-aaf5-bedc47290d53 tempest-VolumesExtendTest-421989206 None] Extend volume completed successfully. Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-f5529808-8e4c-4a6a-b14c-47c1a784f9f0-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-f5529808-8e4c-4a6a-b14c-47c1a784f9f0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-f5529808-8e4c-4a6a-b14c-47c1a784f9f0" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-f5529808-8e4c-4a6a-b14c-47c1a784f9f0" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e25921f-9667-4b21-b718-7aa9a6fe12b1]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:57 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0 Jun 11 05:18:57 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:58 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 1073741824" returned: 0 in 0.900s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:58 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0" returned: 0 in 0.746s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:58 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 Jun 11 05:18:58 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:58 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0 Jun 11 05:18:58 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Acquiring lock "cinder-563c9495-ab9b-4d9c-ae79-9f8c2372d273-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Lock "cinder-563c9495-ab9b-4d9c-ae79-9f8c2372d273-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Acquiring lock "cinder-quobyte-779aba8d-f8b1-4954-92d7-128d723747fd" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Lock "cinder-quobyte-779aba8d-f8b1-4954-92d7-128d723747fd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Acquiring lock "cinder-quobyte-563c9495-ab9b-4d9c-ae79-9f8c2372d273" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Lock "cinder-quobyte-563c9495-ab9b-4d9c-ae79-9f8c2372d273" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Deleting offline snapshot 563c9495-ab9b-4d9c-ae79-9f8c2372d273 of volume 779aba8d-f8b1-4954-92d7-128d723747fd {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] snapshot_file for this snap is: volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[66da29bd-b6db-4645-9a4d-2612e8219fb0]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:58 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 Jun 11 05:18:58 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:59 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:59 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3" returned: 0 in 0.675s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f5529808-8e4c-4a6a-b14c-47c1a784f9f0" returned: 0 in 0.664s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-f5529808-8e4c-4a6a-b14c-47c1a784f9f0" released by "delete_volume" :: held 1.463s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6865d3-4a70-4ef4-ae93-0029d2f5a8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165963e2-5ad6-4d58-bc0d-479d7e8baa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:18:59 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Volume volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 (1ec59025-687e-45ef-bfa9-ffc0613f1fc3): created successfully Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165963e2-5ad6-4d58-bc0d-479d7e8baa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Flow 'volume_create_manager' (f12144e3-fd90-413c-a297-f8301d4a91bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:18:59 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-1e8ed670-ada7-49c3-afb6-eebf9bc4ce98 tempest-GroupsV314Test-1231828751 None] Created volume successfully. Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Created reservations ['e281e1ac-36d6-46de-ba77-1ca9b9ba593a', '1d3127f5-ef5a-4ad7-bbd4-b6ec78d09817', '83e094a8-1ed1-4fc4-adc5-e2a9d9d4ddf3', '6928ecf1-dbac-46d9-a430-695edb62d11e'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:59 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:18:59 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:59 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-c8d3cee8-5f61-4a49-b2a4-d0bde249221c req-c07dfc69-174e-47fe-ba24-2286e0176dc7 tempest-AttachVolumeNegativeTest-1997665377 None] Terminate volume connection completed successfully. Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-c8d3cee8-5f61-4a49-b2a4-d0bde249221c req-c07dfc69-174e-47fe-ba24-2286e0176dc7 tempest-AttachVolumeNegativeTest-1997665377 None] Deleting attachment abed9c26-a50e-42fa-a550-b0b77c98d682. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:18:59 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273" returned: 0 in 0.781s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-779aba8d-f8b1-4954-92d7-128d723747fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3464be9-0e46-42d2-b631-a4d18f91f482]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:18:59 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd Jun 11 05:18:59 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:18:59 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.643s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:18:59 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Deleted volume successfully. Jun 11 05:18:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4618db8b-ce6f-44bb-a8c8-ad37e60ca57c tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-f5529808-8e4c-4a6a-b14c-47c1a784f9f0-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-8ea8f685-38db-4cf5-bdc8-2c4a8cdce452-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-8ea8f685-38db-4cf5-bdc8-2c4a8cdce452-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-36956579-06b9-42e9-9e5e-26517643fe00" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-36956579-06b9-42e9-9e5e-26517643fe00" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-8ea8f685-38db-4cf5-bdc8-2c4a8cdce452" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-8ea8f685-38db-4cf5-bdc8-2c4a8cdce452" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Deleting offline snapshot 8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 of volume 36956579-06b9-42e9-9e5e-26517643fe00 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] snapshot_file for this snap is: volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2468a01-35a0-404f-96f1-812449583e5c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:00 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd" returned: 0 in 0.764s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:00 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 Jun 11 05:19:00 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:00 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 Jun 11 05:19:00 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:00 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Cloning volume 1ec59025-687e-45ef-bfa9-ffc0613f1fc3 to volume c2a14a4c-e835-4b34-bf02-938ef8aa45fb Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Creating offline snapshot 7993144e-5a6c-417e-8cd6-0104c3764d68 of volume 1ec59025-687e-45ef-bfa9-ffc0613f1fc3 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b926929-518a-49f2-9ef4-f575ae814a43]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:00 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 Jun 11 05:19:00 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:01 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452" returned: 0 in 0.828s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36956579-06b9-42e9-9e5e-26517643fe00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:19:01 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273" returned: 0 in 0.769s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:01 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84a6b48-0b89-47ff-9021-684016e01bbe]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:01 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273 Jun 11 05:19:01 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:01 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 Jun 11 05:19:01 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:01 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3" returned: 0 in 0.846s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:01 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 1G Jun 11 05:19:01 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:01 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd.563c9495-ab9b-4d9c-ae79-9f8c2372d273" returned: 0 in 0.682s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:01 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Lock "cinder-quobyte-563c9495-ab9b-4d9c-ae79-9f8c2372d273" released by "_delete_snapshot" :: held 3.122s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:01 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Lock "cinder-quobyte-779aba8d-f8b1-4954-92d7-128d723747fd" released by "delete_snapshot" :: held 3.158s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:01 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Created reservations ['52fefdf2-8040-4ba5-8233-7a79d6a437e0', 'ad4d60ad-e6c7-483c-b063-ecb4f4503046', '5b867c79-f532-448c-9c56-2d3db5187e88', '9a404cb4-57d1-4982-9890-9fa6b8fdfa6a'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:02 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00" returned: 0 in 0.838s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:02 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Delete snapshot completed successfully. Jun 11 05:19:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b7c2d0f1-c90b-444d-b651-422076155d78 tempest-VolumesExtendTest-421989206 None] Lock "cinder-563c9495-ab9b-4d9c-ae79-9f8c2372d273-delete_snapshot" released by "delete_snapshot" :: held 3.334s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:02 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 Jun 11 05:19:02 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Acquiring lock "cinder-779aba8d-f8b1-4954-92d7-128d723747fd-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Lock "cinder-779aba8d-f8b1-4954-92d7-128d723747fd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Acquiring lock "cinder-quobyte-779aba8d-f8b1-4954-92d7-128d723747fd" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Lock "cinder-quobyte-779aba8d-f8b1-4954-92d7-128d723747fd" acquired by "delete_volume" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:02 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[51173cec-209e-4db3-9e6c-afd9bef07fb8]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:02 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 1G" returned: 0 in 0.950s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:02 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 Jun 11 05:19:02 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:02 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd Jun 11 05:19:02 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:02 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452" returned: 0 in 0.735s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:02 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452 Jun 11 05:19:02 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:03 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68" returned: 0 in 0.802s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:03 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:19:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:03 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 Jun 11 05:19:03 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:03 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd" returned: 0 in 1.093s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:03 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd Jun 11 05:19:03 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:03 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00.8ea8f685-38db-4cf5-bdc8-2c4a8cdce452" returned: 0 in 0.973s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:03 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-8ea8f685-38db-4cf5-bdc8-2c4a8cdce452" released by "_delete_snapshot" :: held 3.536s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:03 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-36956579-06b9-42e9-9e5e-26517643fe00" released by "delete_snapshot" :: held 3.565s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:03 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Created reservations ['2be79707-509b-43d8-9125-6c1cdb24345a', '852ece31-1071-4b8b-86d2-dccb1a7e3abd', 'f0a3dd51-6044-4ab6-afe3-a576804c3c26', '87597c44-38b2-47a1-ba4d-72de14560507'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:03 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Delete snapshot completed successfully. Jun 11 05:19:03 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4a7ec372-314c-4176-830d-e5f8d12a616f tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-8ea8f685-38db-4cf5-bdc8-2c4a8cdce452-delete_snapshot" released by "delete_snapshot" :: held 3.703s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:04 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68" returned: 0 in 0.731s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:04 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.info Jun 11 05:19:04 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:04 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-779aba8d-f8b1-4954-92d7-128d723747fd" returned: 0 in 0.762s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Lock "cinder-quobyte-779aba8d-f8b1-4954-92d7-128d723747fd" released by "delete_volume" :: held 1.930s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Created reservations ['b82be06e-ee01-4993-8dc3-1ec1ec84a2c3', '9c649f3c-bd4d-4b18-afb1-362245c0a17a', 'e59547ec-12a4-4e4d-ad39-3449fcc9851b', 'd8087a50-31a2-4bc6-b618-3970d749fac6'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:04 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:19:04 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-36956579-06b9-42e9-9e5e-26517643fe00-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-36956579-06b9-42e9-9e5e-26517643fe00-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-36956579-06b9-42e9-9e5e-26517643fe00" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-36956579-06b9-42e9-9e5e-26517643fe00" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c832ee-4c51-4ca1-9184-c54e4e75c0c6]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:05 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.info" returned: 0 in 0.953s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:05 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.info is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:19:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:05 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 Jun 11 05:19:05 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:05 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.info Jun 11 05:19:05 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:05 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.051s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:05 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:19:05 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Deleted volume successfully. Jun 11 05:19:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1dc39c62-0f72-45e1-892c-25beec630ff9 tempest-VolumesExtendTest-421989206 None] Lock "cinder-779aba8d-f8b1-4954-92d7-128d723747fd-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:05 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00" returned: 0 in 0.939s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:05 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00 Jun 11 05:19:05 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:06 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.info" returned: 0 in 0.964s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Acquiring lock "cinder-quobyte-c2a14a4c-e835-4b34-bf02-938ef8aa45fb" by "_copy_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Lock "cinder-quobyte-c2a14a4c-e835-4b34-bf02-938ef8aa45fb" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] snapshot: 7993144e-5a6c-417e-8cd6-0104c3764d68, volume: c2a14a4c-e835-4b34-bf02-938ef8aa45fb, {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2923c1-6b8d-454b-85e7-d31cb98db939]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:06 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 Jun 11 05:19:06 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:06 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-36956579-06b9-42e9-9e5e-26517643fe00" returned: 0 in 0.723s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-36956579-06b9-42e9-9e5e-26517643fe00" released by "delete_volume" :: held 1.794s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Created reservations ['af73cecd-c10d-444f-a9dc-1386cb355fcc', 'cfacc439-af73-4830-9950-25ab34791084', 'f840f907-1ff8-4e31-8643-a68f294d8513', 'd0d741d6-4d86-49f7-9127-f6b2b9226bac'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:06 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:19:06 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:06 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68" returned: 0 in 0.795s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] will copy from snapshot at /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Creating direct copy from snapshot {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f18d52-b222-4732-9ff1-1bacc161768d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:07 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 Jun 11 05:19:07 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:07 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.675s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:19:07 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Deleted volume successfully. Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-72e03ba8-2413-4e5b-9b21-6c62d18cf9a5 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-36956579-06b9-42e9-9e5e-26517643fe00-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Flow 'volume_create_manager' (66067ecd-908c-4342-97b4-f5c479ab29dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f07d44f-1503-49a0-97b2-3098b50be7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f07d44f-1503-49a0-97b2-3098b50be7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-933818193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa544ed-8070-49f8-ad3c-67ec99c1b495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ff26ce106045be8624ca87fe445e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:19:07Z,use_quota=True,user_id='17ecdde41f9d40d18e602c29668b610c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8010801f-e769-474a-9a3d-c790847150dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8010801f-e769-474a-9a3d-c790847150dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4024130f-dd1e-473b-b323-9f0e440be003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4024130f-dd1e-473b-b323-9f0e440be003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa544ed-8070-49f8-ad3c-67ec99c1b495', 'volume_name': 'volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3c2219-9734-4df5-a995-ad4a282b9fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3c2219-9734-4df5-a995-ad4a282b9fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe158dfd-d6dc-41ca-b2d1-7144f84364a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:07 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Volume 0aa544ed-8070-49f8-ad3c-67ec99c1b495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495', 'volume_size': 1} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:07 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3" returned: 0 in 0.959s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG cinder.utils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Path /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb not found in is_blk_device check {{(pid=92308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 11 05:19:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:07 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb Jun 11 05:19:07 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:08 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:19:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Flow 'volume_create_manager' (55251d00-3dd4-497a-82e8-e41b896b6530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c45edb-5817-4338-9358-a7209385d5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c45edb-5817-4338-9358-a7209385d5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-759696526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1027850644bc44fb80f58af20247193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:19:08Z,use_quota=True,user_id='7f4a216554554cc7b840974f74f2a3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1512335e-8e83-4eea-b26e-77a2b15b03cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1512335e-8e83-4eea-b26e-77a2b15b03cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741f8bda-42b7-45bf-b925-00c688ba4ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741f8bda-42b7-45bf-b925-00c688ba4ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc', 'volume_name': 'volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c7d78c-b04a-43b5-8833-4c8e145f2f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c7d78c-b04a-43b5-8833-4c8e145f2f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de5f569-9341-44e0-9a76-3e0643460cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:08 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Volume f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc', 'volume_size': 1} Jun 11 05:19:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:13 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb" returned: 0 in 5.403s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:13 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[32478d66-b569-431c-ad85-7869146eaad5]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:13 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 Jun 11 05:19:13 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:14 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3" returned: 0 in 0.889s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:14 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:19:14 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Converted 1024.00 MB image at 189.50 MB/s Jun 11 05:19:14 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:19:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:14 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb Jun 11 05:19:14 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:14 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb" returned: 0 in 0.602s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Lock "cinder-quobyte-c2a14a4c-e835-4b34-bf02-938ef8aa45fb" released by "_copy_volume_from_snapshot" :: held 8.757s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Acquiring lock "cinder-quobyte-7993144e-5a6c-417e-8cd6-0104c3764d68" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Lock "cinder-quobyte-7993144e-5a6c-417e-8cd6-0104c3764d68" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Deleting offline snapshot 7993144e-5a6c-417e-8cd6-0104c3764d68 of volume 1ec59025-687e-45ef-bfa9-ffc0613f1fc3 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:19:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] snapshot_file for this snap is: volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:19:14 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15ef710-e4da-4b64-a9a1-b213936caa19]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:15 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 Jun 11 05:19:15 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:15 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68" returned: 0 in 0.750s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:19:15 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73f8e96-aab1-4513-ac13-c0406eaa1bb2]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:15 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 Jun 11 05:19:15 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:16 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3" returned: 0 in 0.707s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:16 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 Jun 11 05:19:16 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:17 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68" returned: 0 in 0.691s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:17 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68 Jun 11 05:19:17 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:17 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3.7993144e-5a6c-417e-8cd6-0104c3764d68" returned: 0 in 0.606s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Lock "cinder-quobyte-7993144e-5a6c-417e-8cd6-0104c3764d68" released by "_delete_snapshot" :: held 2.851s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.041s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.099s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-933818193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa544ed-8070-49f8-ad3c-67ec99c1b495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ff26ce106045be8624ca87fe445e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:19:07Z,use_quota=True,user_id='17ecdde41f9d40d18e602c29668b610c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Creating volume 0aa544ed-8070-49f8-ad3c-67ec99c1b495 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:19:17 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:19:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:17 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 1073741824 Jun 11 05:19:17 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:17 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a432b23d-6961-4c8e-8c58-d66511ba3c4e tempest-GroupsV314Test-1231828751 None] Create group from source-group-5b9eae49-103d-4982-9a5a-b8cdfc65c047 completed successfully. Jun 11 05:19:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Acquiring lock "cinder-quobyte-c2a14a4c-e835-4b34-bf02-938ef8aa45fb" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Lock "cinder-quobyte-c2a14a4c-e835-4b34-bf02-938ef8aa45fb" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:18 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb95735-4af3-4071-99a1-614b8fe77017]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:18 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb Jun 11 05:19:18 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:18 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 1073741824" returned: 0 in 0.863s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:18 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 Jun 11 05:19:18 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:19 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb" returned: 0 in 0.775s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:19 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb Jun 11 05:19:19 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:19 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495" returned: 0 in 0.648s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.814s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-759696526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1027850644bc44fb80f58af20247193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:19:08Z,use_quota=True,user_id='7f4a216554554cc7b840974f74f2a3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Creating volume f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:19:19 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:19 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc 1073741824 Jun 11 05:19:19 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe158dfd-d6dc-41ca-b2d1-7144f84364a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4a7974-23d0-40e9-8b8f-17d014835abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:19 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Volume volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 (0aa544ed-8070-49f8-ad3c-67ec99c1b495): created successfully Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4a7974-23d0-40e9-8b8f-17d014835abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Flow 'volume_create_manager' (66067ecd-908c-4342-97b4-f5c479ab29dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:19 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-70848b89-cfe6-4591-ad5b-cac7776bd0f1 tempest-VolumesSnapshotTestJSON-26480945 None] Created volume successfully. Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:19 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c2a14a4c-e835-4b34-bf02-938ef8aa45fb" returned: 0 in 0.690s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Lock "cinder-quobyte-c2a14a4c-e835-4b34-bf02-938ef8aa45fb" released by "delete_volume" :: held 1.515s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Created reservations ['99f89f44-0da0-4e7c-93d7-65a86b89ab5b'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:19 devstack cinder-volume[92308]: WARNING cinder.quota [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-526163869 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-526163869, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:19:19 devstack cinder-volume[92308]: WARNING cinder.quota [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-526163869 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-526163869, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:19:19 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Created reservations ['13a91343-1725-4ede-973d-5eb773a310e9', 'e4ceb766-ca80-433d-9d62-41ebd0193a62', 'e448db2e-ecc6-4041-b84e-ce5324c2cf9b', '0ae9fb8a-79b7-420a-8352-757924bfa07a'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:20 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:19:20 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:20 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc 1073741824" returned: 0 in 0.990s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:20 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc Jun 11 05:19:20 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:20 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.724s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:19:20 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3bb53c3a-8aeb-481b-85dc-9500a26d516f tempest-GroupsV314Test-1231828751 None] Delete group completed successfully. Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Acquiring lock "cinder-quobyte-1ec59025-687e-45ef-bfa9-ffc0613f1fc3" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Lock "cinder-quobyte-1ec59025-687e-45ef-bfa9-ffc0613f1fc3" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1b89d2-5c33-41a9-9788-74de345eed97]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:21 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 Jun 11 05:19:21 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:21 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc" returned: 0 in 0.841s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:19:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.402s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de5f569-9341-44e0-9a76-3e0643460cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab913e83-f32c-4fe7-bb28-13092e6c8fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] Creating offline snapshot 9a94464c-6e8d-479a-910c-efcc8757b1b4 of volume 0aa544ed-8070-49f8-ad3c-67ec99c1b495 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:19:21 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Volume volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc (f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc): created successfully Jun 11 05:19:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab913e83-f32c-4fe7-bb28-13092e6c8fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Flow 'volume_create_manager' (55251d00-3dd4-497a-82e8-e41b896b6530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:21 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a6cea3-df2c-428c-86e6-8fe0e9df91dc]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:21 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-387ee2d2-193f-4bda-b6a2-e8ac109895d0 tempest-VolumesListTestJSON-1790709228 None] Created volume successfully. Jun 11 05:19:21 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 Jun 11 05:19:21 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:21 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3" returned: 0 in 0.953s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:21 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3 Jun 11 05:19:21 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Flow 'volume_create_manager' (68ab2fc9-f82c-4e55-8706-ea789a179eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eba93b3-f859-4ba5-8e97-c587617bc918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eba93b3-f859-4ba5-8e97-c587617bc918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1811930284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25869d3b-f28c-4856-af29-3670c68c3c34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1027850644bc44fb80f58af20247193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:19:22Z,use_quota=True,user_id='7f4a216554554cc7b840974f74f2a3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ba0d38-6e5a-45f6-bd04-94fa08a96029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ba0d38-6e5a-45f6-bd04-94fa08a96029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79613e13-b742-49f5-afed-3f3f5d420ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79613e13-b742-49f5-afed-3f3f5d420ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25869d3b-f28c-4856-af29-3670c68c3c34', 'volume_name': 'volume-25869d3b-f28c-4856-af29-3670c68c3c34', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006c8edb-3c1d-475c-b109-c840d42e6dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:22 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006c8edb-3c1d-475c-b109-c840d42e6dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04b79f1-ee02-4a83-8b79-f30c50e62d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:22 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Volume 25869d3b-f28c-4856-af29-3670c68c3c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25869d3b-f28c-4856-af29-3670c68c3c34', 'volume_size': 1} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495" returned: 0 in 1.076s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:22 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 1G Jun 11 05:19:22 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:22 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1ec59025-687e-45ef-bfa9-ffc0613f1fc3" returned: 0 in 0.864s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Lock "cinder-quobyte-1ec59025-687e-45ef-bfa9-ffc0613f1fc3" released by "delete_volume" :: held 1.926s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Created reservations ['fe6f5f6e-7b1a-41a7-bdee-f2f15a7acf13'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Created reservations ['e5387ff1-c168-4d4b-a440-9d733f08dd2b', 'c4eaa320-93f1-4596-afbb-40f17586ffda', 'f6011e62-70f6-419e-b256-f08e2a706612', '0b9f6397-30b1-4ea0-acd0-9344a678ec62'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:23 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:19:23 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:23 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 1G" returned: 0 in 0.995s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:23 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 Jun 11 05:19:23 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:23 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.681s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:23 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:19:23 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-967029e9-9ef3-412b-9554-1370ca6fadc8 tempest-GroupsV314Test-1231828751 None] Delete group completed successfully. Jun 11 05:19:24 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4" returned: 0 in 0.698s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:24 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 is being set with open permissions: ugo+rw Jun 11 05:19:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:24 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 Jun 11 05:19:24 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:24 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4" returned: 0 in 0.631s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:24 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=132,cinder:SELECT=104,cinder:INSERT=29,cinder:DELETE=7 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:19:24 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=116,cinder:INSERT=31,cinder:UPDATE=120,cinder:DELETE=9 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:19:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:24 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.info Jun 11 05:19:24 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:25 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.info" returned: 0 in 0.624s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:25 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.info is being set with open permissions: ugo+rw Jun 11 05:19:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:25 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.info Jun 11 05:19:25 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:26 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.info" returned: 0 in 0.659s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.864s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.710s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1811930284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25869d3b-f28c-4856-af29-3670c68c3c34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1027850644bc44fb80f58af20247193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:19:22Z,use_quota=True,user_id='7f4a216554554cc7b840974f74f2a3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Creating volume 25869d3b-f28c-4856-af29-3670c68c3c34 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:19:26 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-25869d3b-f28c-4856-af29-3670c68c3c34 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:26 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-25869d3b-f28c-4856-af29-3670c68c3c34 1073741824 Jun 11 05:19:26 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:26 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-22372eca-dbf4-439d-add3-c1f48820e95f tempest-VolumesSnapshotTestJSON-26480945 None] Create snapshot completed successfully Jun 11 05:19:26 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-25869d3b-f28c-4856-af29-3670c68c3c34 1073741824" returned: 0 in 0.809s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-25869d3b-f28c-4856-af29-3670c68c3c34 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:26 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-25869d3b-f28c-4856-af29-3670c68c3c34 Jun 11 05:19:26 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:27 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-25869d3b-f28c-4856-af29-3670c68c3c34" returned: 0 in 0.656s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:19:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04b79f1-ee02-4a83-8b79-f30c50e62d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25869d3b-f28c-4856-af29-3670c68c3c34', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38848f8-7acb-4f93-9068-dbedf6fc706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:27 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Volume volume-25869d3b-f28c-4856-af29-3670c68c3c34 (25869d3b-f28c-4856-af29-3670c68c3c34): created successfully Jun 11 05:19:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38848f8-7acb-4f93-9068-dbedf6fc706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Flow 'volume_create_manager' (68ab2fc9-f82c-4e55-8706-ea789a179eaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:27 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5c7ce809-d801-4d08-96c5-b3be4577ff10 tempest-VolumesListTestJSON-1790709228 None] Created volume successfully. Jun 11 05:19:27 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:19:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Flow 'volume_create_manager' (c467dc1b-1677-4cbf-a3c0-6c908865fcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e82c5eb-29f9-4225-97f6-e91adb66dff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e82c5eb-29f9-4225-97f6-e91adb66dff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1478502659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e0ae7e-1895-4da4-81d4-930d50810e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ff26ce106045be8624ca87fe445e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9a94464c-6e8d-479a-910c-efcc8757b1b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:19:28Z,use_quota=True,user_id='17ecdde41f9d40d18e602c29668b610c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f016b1-c97d-4290-8bf8-1bade2a1aae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f016b1-c97d-4290-8bf8-1bade2a1aae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15a08ec-3419-460b-84b3-2ad09070d7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15a08ec-3419-460b-84b3-2ad09070d7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c7e0ae7e-1895-4da4-81d4-930d50810e90', 'volume_name': 'volume-c7e0ae7e-1895-4da4-81d4-930d50810e90', 'volume_size': 1, 'snapshot_id': '9a94464c-6e8d-479a-910c-efcc8757b1b4'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b26e9d6-6c40-47d1-a650-f6b73dbe985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b26e9d6-6c40-47d1-a650-f6b73dbe985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ffd9a6-b0cd-400d-b52f-8943bbaaee2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:28 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Volume c7e0ae7e-1895-4da4-81d4-930d50810e90: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c7e0ae7e-1895-4da4-81d4-930d50810e90', 'volume_size': 1, 'snapshot_id': '9a94464c-6e8d-479a-910c-efcc8757b1b4'} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-9a94464c-6e8d-479a-910c-efcc8757b1b4-c7e0ae7e-1895-4da4-81d4-930d50810e90" by "_create_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-9a94464c-6e8d-479a-910c-efcc8757b1b4-c7e0ae7e-1895-4da4-81d4-930d50810e90" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Creating volume c7e0ae7e-1895-4da4-81d4-930d50810e90 from snapshot 9a94464c-6e8d-479a-910c-efcc8757b1b4 {{(pid=92308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-c7e0ae7e-1895-4da4-81d4-930d50810e90" by "_copy_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-c7e0ae7e-1895-4da4-81d4-930d50810e90" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] snapshot: 9a94464c-6e8d-479a-910c-efcc8757b1b4, volume: c7e0ae7e-1895-4da4-81d4-930d50810e90, {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[87124589-9359-4820-b2da-0bcabfc621bf]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:28 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 Jun 11 05:19:28 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Flow 'volume_create_manager' (328bcda5-fec1-444e-9659-71e51e6411f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d1af85-d761-4167-88c1-f0e02d854d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d1af85-d761-4167-88c1-f0e02d854d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-813428972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46edfea1-a80a-4268-8a14-88c815d4f25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68c0c34583446b89fd8609702f695a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:19:29Z,use_quota=True,user_id='3d40915d7e034d64a5f5a7b10811abc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:29 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f8b960-99fb-466a-8c7b-a3423470e8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f8b960-99fb-466a-8c7b-a3423470e8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93093efe-e632-4dad-82b0-2e387c0bff78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93093efe-e632-4dad-82b0-2e387c0bff78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46edfea1-a80a-4268-8a14-88c815d4f25c', 'volume_name': 'volume-46edfea1-a80a-4268-8a14-88c815d4f25c', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5a1ed7-c4c7-4dcd-b791-b31f00ee1f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5a1ed7-c4c7-4dcd-b791-b31f00ee1f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60720f5d-9d5c-47c7-a87b-f59a54b82e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:29 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Volume 46edfea1-a80a-4268-8a14-88c815d4f25c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46edfea1-a80a-4268-8a14-88c815d4f25c', 'volume_size': 1} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4" returned: 0 in 1.139s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] will copy from snapshot at /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Creating direct copy from snapshot {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9912784-daf6-4a69-a619-182bae0591bc]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Flow 'volume_create_manager' (856f3db9-1048-4098-800c-e9f38cf0c92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8936b8ad-cee7-4755-b97b-71ef270b04c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8936b8ad-cee7-4755-b97b-71ef270b04c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1797040378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8889950a-20f5-4e6f-9688-a85668a8928b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1027850644bc44fb80f58af20247193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:19:29Z,use_quota=True,user_id='7f4a216554554cc7b840974f74f2a3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f776823-b0cb-4110-a4eb-c7770f2b7b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f776823-b0cb-4110-a4eb-c7770f2b7b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e1d60e-ce2a-434d-8b15-7f74aae13517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e1d60e-ce2a-434d-8b15-7f74aae13517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8889950a-20f5-4e6f-9688-a85668a8928b', 'volume_name': 'volume-8889950a-20f5-4e6f-9688-a85668a8928b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:29 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2def707-84c8-44e4-a744-9d75c892e2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:29 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2def707-84c8-44e4-a744-9d75c892e2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a590db-bf09-4ec8-aa4e-6ba658b65224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:29 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Volume 8889950a-20f5-4e6f-9688-a85668a8928b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8889950a-20f5-4e6f-9688-a85668a8928b', 'volume_size': 1} Jun 11 05:19:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:30 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495" returned: 0 in 0.785s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:30 devstack cinder-volume[92308]: DEBUG cinder.utils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Path /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90 not found in is_blk_device check {{(pid=92308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 11 05:19:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:19:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:30 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90 Jun 11 05:19:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:30 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:30 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:19:30 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:31 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.830s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:19:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:19:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:19:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:19:37 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90" returned: 0 in 6.866s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:37 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[35775e70-efce-4ad5-9f05-b6c8af672385]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:37 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 Jun 11 05:19:37 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:37 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495" returned: 0 in 0.869s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:37 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90 {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:19:37 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Converted 1024.00 MB image at 149.12 MB/s Jun 11 05:19:37 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90 is being set with open permissions: ugo+rw Jun 11 05:19:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:38 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90 Jun 11 05:19:38 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:38 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90" returned: 0 in 0.633s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-c7e0ae7e-1895-4da4-81d4-930d50810e90" released by "_copy_volume_from_snapshot" :: held 10.500s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-9a94464c-6e8d-479a-910c-efcc8757b1b4-c7e0ae7e-1895-4da4-81d4-930d50810e90" released by "_create_volume_from_snapshot" :: held 10.554s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.582s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.226s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-813428972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46edfea1-a80a-4268-8a14-88c815d4f25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68c0c34583446b89fd8609702f695a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:19:29Z,use_quota=True,user_id='3d40915d7e034d64a5f5a7b10811abc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Creating volume 46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:19:38 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:38 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c 1073741824 Jun 11 05:19:38 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ffd9a6-b0cd-400d-b52f-8943bbaaee2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e0ae7e-1895-4da4-81d4-930d50810e90', 'volume_size': 1, 'snapshot_id': '9a94464c-6e8d-479a-910c-efcc8757b1b4'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13774b3-9a85-4896-ac05-170a4a0d70ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:38 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Volume volume-c7e0ae7e-1895-4da4-81d4-930d50810e90 (c7e0ae7e-1895-4da4-81d4-930d50810e90): created successfully Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13774b3-9a85-4896-ac05-170a4a0d70ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Flow 'volume_create_manager' (c467dc1b-1677-4cbf-a3c0-6c908865fcb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:38 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-6e12b78c-692e-420a-b319-ef2d0098de56 tempest-VolumesSnapshotTestJSON-26480945 None] Created volume successfully. Jun 11 05:19:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-c7e0ae7e-1895-4da4-81d4-930d50810e90-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-c7e0ae7e-1895-4da4-81d4-930d50810e90-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-c7e0ae7e-1895-4da4-81d4-930d50810e90" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-c7e0ae7e-1895-4da4-81d4-930d50810e90" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:39 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da86933-ecd1-41a1-a681-69d407d88258]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:39 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90 Jun 11 05:19:39 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:39 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c 1073741824" returned: 0 in 0.856s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:39 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c Jun 11 05:19:39 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:40 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90" returned: 0 in 0.731s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:40 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:40 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90 Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c" returned: 0 in 0.609s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:40 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.570s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1797040378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8889950a-20f5-4e6f-9688-a85668a8928b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1027850644bc44fb80f58af20247193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:19:29Z,use_quota=True,user_id='7f4a216554554cc7b840974f74f2a3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Creating volume 8889950a-20f5-4e6f-9688-a85668a8928b {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:19:40 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8889950a-20f5-4e6f-9688-a85668a8928b 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60720f5d-9d5c-47c7-a87b-f59a54b82e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46edfea1-a80a-4268-8a14-88c815d4f25c', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec36273-5188-4ef1-b30e-e791ef80a9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:40 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8889950a-20f5-4e6f-9688-a85668a8928b 1073741824 Jun 11 05:19:40 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:40 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Volume volume-46edfea1-a80a-4268-8a14-88c815d4f25c (46edfea1-a80a-4268-8a14-88c815d4f25c): created successfully Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec36273-5188-4ef1-b30e-e791ef80a9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Flow 'volume_create_manager' (328bcda5-fec1-444e-9659-71e51e6411f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:40 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-39690cc0-5dd8-4df8-a274-cedcc00f2637 tempest-SnapshotsActionsTest-1260505501 None] Created volume successfully. Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:40 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c7e0ae7e-1895-4da4-81d4-930d50810e90" returned: 0 in 0.790s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-c7e0ae7e-1895-4da4-81d4-930d50810e90" released by "delete_volume" :: held 1.570s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:40 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Created reservations ['a85b8634-63b6-40e2-b8e4-0bcc4534f269', '07175cfe-1cfd-4272-bf1a-bde4cc135606', 'a82a5060-5d41-4a01-b2af-c852700123e7', '3bbdce35-c4e8-4874-a81a-fa10d17d1bb8'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:41 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:19:41 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:41 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8889950a-20f5-4e6f-9688-a85668a8928b 1073741824" returned: 0 in 1.012s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8889950a-20f5-4e6f-9688-a85668a8928b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:41 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8889950a-20f5-4e6f-9688-a85668a8928b Jun 11 05:19:41 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-9a94464c-6e8d-479a-910c-efcc8757b1b4-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-9a94464c-6e8d-479a-910c-efcc8757b1b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-0aa544ed-8070-49f8-ad3c-67ec99c1b495" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:41 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-0aa544ed-8070-49f8-ad3c-67ec99c1b495" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-9a94464c-6e8d-479a-910c-efcc8757b1b4" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.635s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:19:41 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Deleted volume successfully. Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-9a94464c-6e8d-479a-910c-efcc8757b1b4" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Deleting offline snapshot 9a94464c-6e8d-479a-910c-efcc8757b1b4 of volume 0aa544ed-8070-49f8-ad3c-67ec99c1b495 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] snapshot_file for this snap is: volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[471b4741-d79e-4e53-a9b4-04881ca2db54]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-03e94fbb-8a2e-49e4-9af9-a38524256738 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-c7e0ae7e-1895-4da4-81d4-930d50810e90-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:41 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:41 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 Jun 11 05:19:41 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8889950a-20f5-4e6f-9688-a85668a8928b" returned: 0 in 0.721s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.217s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] Creating offline snapshot a25f7139-ce95-40a1-9582-4c1283456993 of volume 46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a590db-bf09-4ec8-aa4e-6ba658b65224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8889950a-20f5-4e6f-9688-a85668a8928b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304ca178-8555-4937-872e-a6eb8c73b510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0017b886-a435-4bf4-9b0d-5790acee4acf]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:42 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Volume volume-8889950a-20f5-4e6f-9688-a85668a8928b (8889950a-20f5-4e6f-9688-a85668a8928b): created successfully Jun 11 05:19:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304ca178-8555-4937-872e-a6eb8c73b510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Flow 'volume_create_manager' (856f3db9-1048-4098-800c-e9f38cf0c92b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:42 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c169eb97-0939-44a2-a047-0fc58a8c8b95 tempest-VolumesListTestJSON-1790709228 None] Created volume successfully. Jun 11 05:19:42 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c Jun 11 05:19:42 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:42 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4" returned: 0 in 0.749s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:19:42 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b183860-7965-478c-a739-353248024f4a]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:42 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 Jun 11 05:19:42 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:42 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c" returned: 0 in 0.788s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:42 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 1G Jun 11 05:19:42 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:43 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495" returned: 0 in 0.735s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:43 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 Jun 11 05:19:43 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:43 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 1G" returned: 0 in 0.834s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:43 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 Jun 11 05:19:43 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:44 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4" returned: 0 in 0.872s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:44 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4 Jun 11 05:19:44 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:44 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993" returned: 0 in 0.788s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:44 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 is being set with open permissions: ugo+rw Jun 11 05:19:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:44 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 Jun 11 05:19:44 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:44 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495.9a94464c-6e8d-479a-910c-efcc8757b1b4" returned: 0 in 0.691s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:44 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-9a94464c-6e8d-479a-910c-efcc8757b1b4" released by "_delete_snapshot" :: held 3.176s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:44 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-0aa544ed-8070-49f8-ad3c-67ec99c1b495" released by "delete_snapshot" :: held 3.230s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:45 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Created reservations ['34cff59b-874f-44a8-b463-d81a411eec44', 'c3d2a389-d539-4551-832c-1d7277a655a7', '87521f6c-a8d3-4d97-b180-553a8df92779', '3558fbda-03d5-422d-a7c8-07f02c89cab7'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:45 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Delete snapshot completed successfully. Jun 11 05:19:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ed124e57-ef2f-48da-98a8-4a9b94821ff2 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-9a94464c-6e8d-479a-910c-efcc8757b1b4-delete_snapshot" released by "delete_snapshot" :: held 3.409s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:45 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993" returned: 0 in 0.726s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:45 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.info Jun 11 05:19:45 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "cinder-8889950a-20f5-4e6f-9688-a85668a8928b-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Lock "cinder-8889950a-20f5-4e6f-9688-a85668a8928b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "cinder-quobyte-8889950a-20f5-4e6f-9688-a85668a8928b" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Lock "cinder-quobyte-8889950a-20f5-4e6f-9688-a85668a8928b" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:45 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[af170042-8a24-4dd5-a64c-1b1ea8dda294]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8889950a-20f5-4e6f-9688-a85668a8928b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:45 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.info" returned: 0 in 0.620s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:45 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.info is being set with open permissions: ugo+rw Jun 11 05:19:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:45 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.info Jun 11 05:19:45 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:45 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8889950a-20f5-4e6f-9688-a85668a8928b Jun 11 05:19:45 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-0aa544ed-8070-49f8-ad3c-67ec99c1b495-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:46 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-0aa544ed-8070-49f8-ad3c-67ec99c1b495-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:46 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-0aa544ed-8070-49f8-ad3c-67ec99c1b495" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:46 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-0aa544ed-8070-49f8-ad3c-67ec99c1b495" acquired by "delete_volume" :: waited 0.026s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:46 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[834138bc-cf9f-4238-813e-bee8ed8fce63]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:46 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 Jun 11 05:19:46 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:46 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.info" returned: 0 in 0.681s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:46 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.536s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8889950a-20f5-4e6f-9688-a85668a8928b" returned: 0 in 0.761s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8889950a-20f5-4e6f-9688-a85668a8928b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:46 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8889950a-20f5-4e6f-9688-a85668a8928b Jun 11 05:19:46 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:46 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8f612b6a-8cd1-4a7b-b8d5-a8fe491b8a33 tempest-SnapshotsActionsTest-1260505501 None] Create snapshot completed successfully Jun 11 05:19:46 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495" returned: 0 in 0.766s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:46 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495 Jun 11 05:19:46 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:47 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8889950a-20f5-4e6f-9688-a85668a8928b" returned: 0 in 0.603s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Lock "cinder-quobyte-8889950a-20f5-4e6f-9688-a85668a8928b" released by "delete_volume" :: held 1.418s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Created reservations ['29b074be-7874-4512-a298-f47c6b83df7e', '30589cd8-36a1-4de5-9e8f-90d9d1b192e7', 'd2c41399-7566-4d88-9f4a-3a5cac5b3e73', 'ee9facd2-7ff4-479a-8491-ec3d6ffa1af3'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:47 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:19:47 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] Creating offline snapshot 3148968a-1934-475b-883b-4be4c9b7a805 of volume 46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21cebbf-d19f-41a4-9d46-9cce69623067]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:47 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0aa544ed-8070-49f8-ad3c-67ec99c1b495" returned: 0 in 0.673s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-0aa544ed-8070-49f8-ad3c-67ec99c1b495" released by "delete_volume" :: held 1.523s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:47 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 Jun 11 05:19:47 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Created reservations ['8531be96-2e08-4a80-bad0-afe853239de5', '48d619f0-3a47-48ec-b9bb-6f1cae62567e', '96c39638-d29a-4bb3-9a0a-ad19c6b5b63c', 'bfaed24d-7b2b-4f66-a5ae-674ab77a476b'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:47 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:19:47 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:48 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.744s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:19:48 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Deleted volume successfully. Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "cinder-25869d3b-f28c-4856-af29-3670c68c3c34-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ab6c462d-e449-4e9f-b1f0-a1e6d12a019c tempest-VolumesListTestJSON-1790709228 None] Lock "cinder-8889950a-20f5-4e6f-9688-a85668a8928b-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Lock "cinder-25869d3b-f28c-4856-af29-3670c68c3c34-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "cinder-quobyte-25869d3b-f28c-4856-af29-3670c68c3c34" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Lock "cinder-quobyte-25869d3b-f28c-4856-af29-3670c68c3c34" acquired by "delete_volume" :: waited 0.030s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac68f48f-095f-4fdc-9e53-fedabd4d59ad]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-25869d3b-f28c-4856-af29-3670c68c3c34 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:48 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-25869d3b-f28c-4856-af29-3670c68c3c34 Jun 11 05:19:48 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "cinder-quobyte-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[299bfaa1-4e49-4aad-a6b6-0c006333523d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:48 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993" returned: 0 in 1.129s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46edfea1-a80a-4268-8a14-88c815d4f25c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:48 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 1G Jun 11 05:19:48 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:48 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:48 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 Jun 11 05:19:48 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.007s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:19:48 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Deleted volume successfully. Jun 11 05:19:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-42432ed2-f488-4953-ba7a-b7060c265ed3 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-0aa544ed-8070-49f8-ad3c-67ec99c1b495-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:49 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-25869d3b-f28c-4856-af29-3670c68c3c34" returned: 0 in 0.990s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-25869d3b-f28c-4856-af29-3670c68c3c34 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:49 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-25869d3b-f28c-4856-af29-3670c68c3c34 Jun 11 05:19:49 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:49 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37" returned: 0 in 0.839s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:49 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37 Jun 11 05:19:49 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:49 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 1G" returned: 0 in 1.049s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:49 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 Jun 11 05:19:49 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:49 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-25869d3b-f28c-4856-af29-3670c68c3c34" returned: 0 in 0.716s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:49 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Lock "cinder-quobyte-25869d3b-f28c-4856-af29-3670c68c3c34" released by "delete_volume" :: held 1.787s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Created reservations ['214dda07-76f8-4dfe-9901-7a1e2e3b9c5b', 'd12fe26f-5b71-42fb-ac8b-4b810fe37f7c', '7029e2a3-ad09-4444-a80c-4019693a870d', '7fad979c-a09a-4512-aa31-b0246b4e28b9'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:50 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:19:50 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:50 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37" returned: 0 in 0.796s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-quobyte-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37" released by "delete_volume" :: held 1.717s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Created reservations ['2d6629da-966c-4977-ad1f-d4a1d61824f9', '54131468-405e-48c8-ac42-dd6b9e3449b9', 'bc855f4f-3d8c-4d56-a819-9dd335913e7e', '84ed2046-de56-4e8a-b677-260fa6389bf2'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:50 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805" returned: 0 in 0.699s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:50 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 is being set with open permissions: ugo+rw Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:50 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:19:50 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "cinder-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:50 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 Jun 11 05:19:50 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Lock "cinder-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "cinder-quobyte-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Lock "cinder-quobyte-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc" acquired by "delete_volume" :: waited 0.026s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da9e3c4-ff69-4748-8270-54d3c1269fef]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:50 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc Jun 11 05:19:50 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:50 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.744s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:19:50 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Deleted volume successfully. Jun 11 05:19:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9bd78953-d2cc-4e6c-ab66-eedf098135af tempest-VolumesListTestJSON-1790709228 None] Lock "cinder-25869d3b-f28c-4856-af29-3670c68c3c34-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:51 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.748s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:19:51 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Deleted volume successfully. Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7c9c58cb-c594-40f9-be31-25b85bfff5b7 tempest-VolumesSnapshotTestJSON-26480945 None] Lock "cinder-b1a6c188-d2cf-4158-aaf8-4df3b8ecec37-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:51 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805" returned: 0 in 0.824s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.817s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:51 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c3dc9129-0795-47f3-b7c2-3fccd1648b6a tempest-SnapshotsActionsTest-1260505501 None] Create snapshot completed successfully Jun 11 05:19:51 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc" returned: 0 in 0.844s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:51 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc Jun 11 05:19:51 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Acquiring lock "cinder-3148968a-1934-475b-883b-4be4c9b7a805-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-3148968a-1934-475b-883b-4be4c9b7a805-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Acquiring lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Acquiring lock "cinder-quobyte-3148968a-1934-475b-883b-4be4c9b7a805" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-3148968a-1934-475b-883b-4be4c9b7a805" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Deleting offline snapshot 3148968a-1934-475b-883b-4be4c9b7a805 of volume 46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] snapshot_file for this snap is: volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fca94a-2f69-4e1b-bf4b-6b187b5b28e7]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:52 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 Jun 11 05:19:52 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:52 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc" returned: 0 in 0.657s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:52 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Lock "cinder-quobyte-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc" released by "delete_volume" :: held 1.569s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:52 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Created reservations ['4ddeec11-6884-4b2f-8342-72c76c61a2c5', 'd203cc0c-4fb2-49b1-8bb4-160ed5a9151a', '8b1498e8-17fa-420b-9ed4-06eb6d56544c', '1326e3ca-d72d-417e-97fe-36eb3efe2481'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:52 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:19:52 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:52 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805" returned: 0 in 0.789s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46edfea1-a80a-4268-8a14-88c815d4f25c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:19:52 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25c0636-a6be-4dd6-8983-975361ff61a3]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:52 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 Jun 11 05:19:52 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:53 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.730s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:53 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:19:53 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Deleted volume successfully. Jun 11 05:19:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-de8ac319-0a81-482f-9d0f-88238a50daf2 tempest-VolumesListTestJSON-1790709228 None] Lock "cinder-f7a7f175-2108-4da0-8cd8-0cbfe0cd85fc-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:53 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993" returned: 0 in 0.920s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46edfea1-a80a-4268-8a14-88c815d4f25c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:19:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:53 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 Jun 11 05:19:53 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:54 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805" returned: 0 in 0.903s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:54 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805 Jun 11 05:19:54 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Flow 'volume_create_manager' (9505ee0d-a939-4d3b-9725-a569bb167097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c412fa0-56f2-427f-a5e2-c699279eb1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c412fa0-56f2-427f-a5e2-c699279eb1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-535222595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b48a88-91b8-400a-a9a9-50bd8415c59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d18a39d02875433086d5f91c14ed92a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:19:55Z,use_quota=True,user_id='fb06bed8ad484f9792ccca64e542e62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205212e7-adf7-4cf8-8362-40e10a0dfd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205212e7-adf7-4cf8-8362-40e10a0dfd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7213de17-ed1c-48cb-942e-1f1cef92c4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7213de17-ed1c-48cb-942e-1f1cef92c4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63b48a88-91b8-400a-a9a9-50bd8415c59e', 'volume_name': 'volume-63b48a88-91b8-400a-a9a9-50bd8415c59e', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14c118d-acb1-4777-a173-bda581ecb0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14c118d-acb1-4777-a173-bda581ecb0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7699a179-1a5c-47c1-9a89-dbc308fac989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:55 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Volume 63b48a88-91b8-400a-a9a9-50bd8415c59e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63b48a88-91b8-400a-a9a9-50bd8415c59e', 'volume_size': 1} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-535222595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b48a88-91b8-400a-a9a9-50bd8415c59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d18a39d02875433086d5f91c14ed92a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:19:55Z,use_quota=True,user_id='fb06bed8ad484f9792ccca64e542e62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Creating volume 63b48a88-91b8-400a-a9a9-50bd8415c59e {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:19:55 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:55 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e 1073741824 Jun 11 05:19:55 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:55 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.3148968a-1934-475b-883b-4be4c9b7a805" returned: 0 in 0.862s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-3148968a-1934-475b-883b-4be4c9b7a805" released by "_delete_snapshot" :: held 3.598s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" released by "delete_snapshot" :: held 3.644s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Created reservations ['a6920a8d-9942-4486-9be8-abbaa2cdaf57', '5fa7f227-441c-4435-86a7-7339dd4c186e', '403bda95-6d7d-4286-b789-c602de8bf997', 'dbb8ae4c-f464-4e32-987d-82be0995ecde'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:19:55 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Delete snapshot completed successfully. Jun 11 05:19:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-456b13b3-b755-4b01-ae6b-6a07e912c05b tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-3148968a-1934-475b-883b-4be4c9b7a805-delete_snapshot" released by "delete_snapshot" :: held 3.855s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:19:56 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e 1073741824" returned: 0 in 0.993s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:56 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e Jun 11 05:19:56 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:19:56 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e" returned: 0 in 0.736s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:19:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:19:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.426s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:19:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7699a179-1a5c-47c1-9a89-dbc308fac989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63b48a88-91b8-400a-a9a9-50bd8415c59e', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3595da9-cb0d-4793-9e92-7c4c2a67cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:19:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] Creating offline snapshot 2f2909b1-85eb-4311-b885-2a0a0da283bd of volume 46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:19:56 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Volume volume-63b48a88-91b8-400a-a9a9-50bd8415c59e (63b48a88-91b8-400a-a9a9-50bd8415c59e): created successfully Jun 11 05:19:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3595da9-cb0d-4793-9e92-7c4c2a67cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:19:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Flow 'volume_create_manager' (9505ee0d-a939-4d3b-9725-a569bb167097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:19:57 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c662b181-fbf3-4932-bea8-7647e021e92c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:19:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:57 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-136c85ac-b14b-491a-9d13-5c14d7774623 tempest-AttachVolumeNegativeTest-1997665377 None] Created volume successfully. Jun 11 05:19:57 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 Jun 11 05:19:57 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:57 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993" returned: 0 in 0.985s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46edfea1-a80a-4268-8a14-88c815d4f25c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:19:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:58 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd 1G Jun 11 05:19:58 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:59 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd 1G" returned: 0 in 1.022s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:59 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd Jun 11 05:19:59 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:19:59 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jun 11 05:19:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd" returned: 0 in 0.773s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:19:59 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd is being set with open permissions: ugo+rw Jun 11 05:19:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:19:59 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd Jun 11 05:19:59 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-4008ee4d-ef39-4783-88ea-0fc74a49b9a9 req-e62aeed7-9316-4f98-9d4a-6ba5811739f5 tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:00 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd" returned: 0 in 0.772s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.701s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-4008ee4d-ef39-4783-88ea-0fc74a49b9a9 req-e62aeed7-9316-4f98-9d4a-6ba5811739f5 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.260s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56e1736-2575-41ac-be4d-b03ac048babc]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-4008ee4d-ef39-4783-88ea-0fc74a49b9a9 req-e62aeed7-9316-4f98-9d4a-6ba5811739f5 tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:00 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8e2d144f-a8b8-472e-a58d-642fbcae5fb7 tempest-SnapshotsActionsTest-1260505501 None] Create snapshot completed successfully Jun 11 05:20:00 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e Jun 11 05:20:00 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:01 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-4008ee4d-ef39-4783-88ea-0fc74a49b9a9 req-e62aeed7-9316-4f98-9d4a-6ba5811739f5 tempest-AttachVolumeNegativeTest-1997665377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e" returned: 0 in 0.772s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-4008ee4d-ef39-4783-88ea-0fc74a49b9a9 req-e62aeed7-9316-4f98-9d4a-6ba5811739f5 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.798s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-4008ee4d-ef39-4783-88ea-0fc74a49b9a9 req-e62aeed7-9316-4f98-9d4a-6ba5811739f5 tempest-AttachVolumeNegativeTest-1997665377 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-63b48a88-91b8-400a-a9a9-50bd8415c59e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fad88e22-68c3-463a-a7a1-8857685cd86c', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:20:01 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-4008ee4d-ef39-4783-88ea-0fc74a49b9a9 req-e62aeed7-9316-4f98-9d4a-6ba5811739f5 tempest-AttachVolumeNegativeTest-1997665377 None] attachment_update completed successfully. Jun 11 05:20:01 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Acquiring lock "cinder-2f2909b1-85eb-4311-b885-2a0a0da283bd-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:01 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-2f2909b1-85eb-4311-b885-2a0a0da283bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:01 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Acquiring lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" acquired by "delete_snapshot" :: waited 0.032s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Acquiring lock "cinder-quobyte-2f2909b1-85eb-4311-b885-2a0a0da283bd" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-2f2909b1-85eb-4311-b885-2a0a0da283bd" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Deleting offline snapshot 2f2909b1-85eb-4311-b885-2a0a0da283bd of volume 46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:20:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] snapshot_file for this snap is: volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:20:02 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c757d340-12aa-43bb-ac7c-08f70284569f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:02 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd Jun 11 05:20:02 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:03 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd" returned: 0 in 0.977s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46edfea1-a80a-4268-8a14-88c815d4f25c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:20:03 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98f1d97-466d-4a4f-904f-9001ea4e5fcf]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:03 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 Jun 11 05:20:03 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:04 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993" returned: 0 in 0.888s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46edfea1-a80a-4268-8a14-88c815d4f25c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:20:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:04 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd Jun 11 05:20:04 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:05 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd" returned: 0 in 0.967s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:05 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd Jun 11 05:20:05 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:05 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.2f2909b1-85eb-4311-b885-2a0a0da283bd" returned: 0 in 0.824s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-2f2909b1-85eb-4311-b885-2a0a0da283bd" released by "_delete_snapshot" :: held 3.865s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" released by "delete_snapshot" :: held 3.901s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:05 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Created reservations ['b77e6021-784b-4fea-ba6d-26111d11e531', 'f631244a-b0b2-4fee-af01-0f3d72641a2c', '8084405d-962b-4a5d-8419-045d4f47e59d', '03742ae7-ba02-4529-aca8-b04dfa54d501'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:20:06 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Delete snapshot completed successfully. Jun 11 05:20:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f45f03d2-71b1-4c39-95a6-8432d8f398f4 tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-2f2909b1-85eb-4311-b885-2a0a0da283bd-delete_snapshot" released by "delete_snapshot" :: held 4.099s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] Creating offline snapshot b8a926d8-3050-437e-ba18-8ddc71e858ff of volume 46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:20:06 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad074e3-b8da-44d4-951c-da7b46019406]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:07 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 Jun 11 05:20:07 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:07 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993" returned: 0 in 0.916s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46edfea1-a80a-4268-8a14-88c815d4f25c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:20:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:07 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff 1G Jun 11 05:20:07 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:08 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-f85b4207-c699-4e26-88ce-8f611112ee04 req-4a2c6cf9-ab2e-4b98-8028-b8ed8b62d439 tempest-AttachVolumeNegativeTest-1997665377 None] Terminate volume connection completed successfully. Jun 11 05:20:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-f85b4207-c699-4e26-88ce-8f611112ee04 req-4a2c6cf9-ab2e-4b98-8028-b8ed8b62d439 tempest-AttachVolumeNegativeTest-1997665377 None] Deleting attachment fad88e22-68c3-463a-a7a1-8857685cd86c. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:20:09 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff 1G" returned: 0 in 1.241s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:09 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff Jun 11 05:20:09 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:09 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff" returned: 0 in 0.876s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:09 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff is being set with open permissions: ugo+rw Jun 11 05:20:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:09 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff Jun 11 05:20:09 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:10 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff" returned: 0 in 1.017s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.234s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:11 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-bad91bce-6e4a-4b13-8623-70f0c5a8a201 tempest-SnapshotsActionsTest-1260505501 None] Create snapshot completed successfully Jun 11 05:20:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Acquiring lock "cinder-b8a926d8-3050-437e-ba18-8ddc71e858ff-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-b8a926d8-3050-437e-ba18-8ddc71e858ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Acquiring lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" acquired by "delete_snapshot" :: waited 0.060s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Acquiring lock "cinder-quobyte-b8a926d8-3050-437e-ba18-8ddc71e858ff" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-b8a926d8-3050-437e-ba18-8ddc71e858ff" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Deleting offline snapshot b8a926d8-3050-437e-ba18-8ddc71e858ff of volume 46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:20:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] snapshot_file for this snap is: volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:20:12 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ce3b0c-f28e-4b13-a9ed-6f8ea8ced914]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:12 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff Jun 11 05:20:12 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:13 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff" returned: 0 in 0.814s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46edfea1-a80a-4268-8a14-88c815d4f25c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:20:13 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[781ed9b4-f452-4a1f-93a4-9b8294d74c6b]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:13 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 Jun 11 05:20:13 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:14 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993" returned: 0 in 0.853s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46edfea1-a80a-4268-8a14-88c815d4f25c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:20:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:14 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff Jun 11 05:20:14 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:15 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff" returned: 0 in 0.872s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:15 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff Jun 11 05:20:15 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:15 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.b8a926d8-3050-437e-ba18-8ddc71e858ff" returned: 0 in 0.710s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-b8a926d8-3050-437e-ba18-8ddc71e858ff" released by "_delete_snapshot" :: held 3.400s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" released by "delete_snapshot" :: held 3.440s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:15 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Created reservations ['45c4613e-a848-4461-87bf-10159b778210', '5f975ef4-734f-4d46-8827-86363b1da3c7', 'd680d97e-8076-4ab9-917e-84ed3c0fb57f', 'b4f07d27-e522-46df-8008-de462c144ffd'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:20:15 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Delete snapshot completed successfully. Jun 11 05:20:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-361db0a0-e7d2-40ca-b083-b5b6e735a49d tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-b8a926d8-3050-437e-ba18-8ddc71e858ff-delete_snapshot" released by "delete_snapshot" :: held 3.658s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] Creating offline snapshot c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b of volume 46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:20:17 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec3b40d-d2b0-49a9-a82c-7a35cd522405]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:17 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 Jun 11 05:20:17 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:18 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993" returned: 0 in 0.982s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46edfea1-a80a-4268-8a14-88c815d4f25c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:20:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:18 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b 1G Jun 11 05:20:18 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:18 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b 1G" returned: 0 in 0.904s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:19 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b Jun 11 05:20:19 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:19 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b" returned: 0 in 0.852s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:19 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b is being set with open permissions: ugo+rw Jun 11 05:20:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:19 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b Jun 11 05:20:19 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:20 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b" returned: 0 in 0.818s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.718s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:20 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-7d3c565a-a357-41fd-be0e-277b1db82a44 tempest-SnapshotsActionsTest-1260505501 None] Create snapshot completed successfully Jun 11 05:20:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Acquiring lock "cinder-c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Acquiring lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Acquiring lock "cinder-quobyte-c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Deleting offline snapshot c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b of volume 46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:20:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] snapshot_file for this snap is: volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:20:21 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e716b1ad-8800-4ecb-b92c-0598f099430f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:21 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b Jun 11 05:20:21 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:22 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b" returned: 0 in 1.022s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46edfea1-a80a-4268-8a14-88c815d4f25c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:20:22 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[578cdab7-5bb8-46f7-92fa-b1907807fa9c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:22 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 Jun 11 05:20:22 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:23 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993" returned: 0 in 1.024s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46edfea1-a80a-4268-8a14-88c815d4f25c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:20:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:23 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b Jun 11 05:20:23 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:23 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:20:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Flow 'volume_create_manager' (06aa41ed-574e-4c4c-815e-e01094b91bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:20:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771ef0da-7222-42e2-9872-759a747bfcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771ef0da-7222-42e2-9872-759a747bfcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2003775514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bcc8e4-338e-4ef3-bccd-78046d731135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b605f43d2a4de0a8e8825aa6dd01f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:20:24Z,use_quota=True,user_id='c5cdb711b1694d6dac12cdb12f0388fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d40bcaf0-cf8f-4727-96f2-72354571228f),volume_type_id=d40bcaf0-cf8f-4727-96f2-72354571228f)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515f96c5-e52b-4e00-a5df-74603c7642a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515f96c5-e52b-4e00-a5df-74603c7642a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e834f1-84ac-4bf9-8310-ba4cb682b652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e834f1-84ac-4bf9-8310-ba4cb682b652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bcc8e4-338e-4ef3-bccd-78046d731135', 'volume_name': 'volume-96bcc8e4-338e-4ef3-bccd-78046d731135', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5a95af-812e-47f0-ad1d-f32cab3350d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5a95af-812e-47f0-ad1d-f32cab3350d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf5c8f3-fe98-47d0-9405-224d15163f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:24 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Volume 96bcc8e4-338e-4ef3-bccd-78046d731135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bcc8e4-338e-4ef3-bccd-78046d731135', 'volume_size': 1} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2003775514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bcc8e4-338e-4ef3-bccd-78046d731135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b605f43d2a4de0a8e8825aa6dd01f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:20:24Z,use_quota=True,user_id='c5cdb711b1694d6dac12cdb12f0388fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d40bcaf0-cf8f-4727-96f2-72354571228f),volume_type_id=d40bcaf0-cf8f-4727-96f2-72354571228f)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Creating volume 96bcc8e4-338e-4ef3-bccd-78046d731135 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:20:24 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:24 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135 1073741824 Jun 11 05:20:24 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Flow 'volume_create_manager' (e282a6d0-aba2-456e-aed1-df661ea8afbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4d3a40-eb1a-4a08-8364-2392bd8b0f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4d3a40-eb1a-4a08-8364-2392bd8b0f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1516929033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b605f43d2a4de0a8e8825aa6dd01f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:20:24Z,use_quota=True,user_id='c5cdb711b1694d6dac12cdb12f0388fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d060a83d-1259-48b9-bba5-eb942c7f036e),volume_type_id=d060a83d-1259-48b9-bba5-eb942c7f036e)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b143c45-98b0-4e47-b316-6843617d8016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b143c45-98b0-4e47-b316-6843617d8016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3004ec44-8ca4-4d52-b397-4fdaa3bbdf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3004ec44-8ca4-4d52-b397-4fdaa3bbdf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0', 'volume_name': 'volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e681e06-75ec-4acc-82f2-bc821f44a938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e681e06-75ec-4acc-82f2-bc821f44a938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f9d22e-03e0-45cf-8543-8f5e0f1dbaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:24 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Volume 82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0', 'volume_size': 1} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:24 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b" returned: 0 in 1.355s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:25 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b Jun 11 05:20:25 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=86,cinder:DELETE=9,cinder:UPDATE=95,cinder:INSERT=15 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=79,cinder:UPDATE=91,cinder:INSERT=31,cinder:DELETE=8 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Flow 'volume_create_manager' (6b4b9626-a26c-4f42-8d7a-4604df57fbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa3f4c0-8bf7-4a03-b339-b51513f7c307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa3f4c0-8bf7-4a03-b339-b51513f7c307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-243537444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8783d4cf-70c0-4cd9-9b53-e20973af042c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b605f43d2a4de0a8e8825aa6dd01f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:20:25Z,use_quota=True,user_id='c5cdb711b1694d6dac12cdb12f0388fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac555f23-216b-45c2-ac24-24d0c4888054),volume_type_id=ac555f23-216b-45c2-ac24-24d0c4888054)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62e146f-9d1a-403e-9b42-faa55db4974e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62e146f-9d1a-403e-9b42-faa55db4974e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26a3629-8f34-427e-8269-d74867ec8010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.image.glance [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Creating Keystone auth plugin from conf {{(pid=92308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 11 05:20:25 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135 1073741824" returned: 0 in 1.397s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:25 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135 Jun 11 05:20:25 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:25 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b" returned: 0 in 0.842s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b" released by "_delete_snapshot" :: held 4.384s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26a3629-8f34-427e-8269-d74867ec8010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8783d4cf-70c0-4cd9-9b53-e20973af042c', 'volume_name': 'volume-8783d4cf-70c0-4cd9-9b53-e20973af042c', 'volume_size': 1, 'image_id': '8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--837745623', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0b605f43d2a4de0a8e8825aa6dd01f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991', 'created_at': datetime.datetime(2026, 6, 11, 3, 20, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 20, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991/file', 'properties': {}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c05601f-8fd2-4a96-9d98-a608067f9b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c05601f-8fd2-4a96-9d98-a608067f9b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b64fa1e-316e-44ef-bf55-43d33280ddd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:25 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Volume 8783d4cf-70c0-4cd9-9b53-e20973af042c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8783d4cf-70c0-4cd9-9b53-e20973af042c', 'volume_size': 1, 'image_id': '8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--837745623', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0b605f43d2a4de0a8e8825aa6dd01f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991', 'created_at': datetime.datetime(2026, 6, 11, 3, 20, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 20, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991/file', 'properties': {}}, 'image_service': } Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Trying to clone 8783d4cf-70c0-4cd9-9b53-e20973af042c from image 8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991', 'metadata': {}}]). {{(pid=92308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 11 05:20:25 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" released by "delete_snapshot" :: held 4.470s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Created reservations ['45d56bdd-a40a-4128-a6cb-174747c03d5b', '4a9cf3a7-7f62-41de-baa1-377d54330f14', '3bbe23c2-a79b-42e8-b7de-7a7ba82cbf85', '583ce225-edea-4782-aaa5-bd51380c14ec'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:20:26 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Delete snapshot completed successfully. Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ff7da396-2075-4ac1-af13-8586f37e62f8 tempest-SnapshotsActionsTest-2098420685 None] Lock "cinder-c021d3ec-49cb-4cc3-a70b-8a153bf5ec1b-delete_snapshot" released by "delete_snapshot" :: held 4.752s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:26 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135" returned: 0 in 0.926s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] <== create_volume: return (2374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.378s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.905s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1516929033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b605f43d2a4de0a8e8825aa6dd01f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:20:24Z,use_quota=True,user_id='c5cdb711b1694d6dac12cdb12f0388fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d060a83d-1259-48b9-bba5-eb942c7f036e),volume_type_id=d060a83d-1259-48b9-bba5-eb942c7f036e)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Creating volume 82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:20:26 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:26 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0 1073741824 Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf5c8f3-fe98-47d0-9405-224d15163f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bcc8e4-338e-4ef3-bccd-78046d731135', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:26 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d4707a-3ce0-4cdc-9b97-017c443604b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:26 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Volume volume-96bcc8e4-338e-4ef3-bccd-78046d731135 (96bcc8e4-338e-4ef3-bccd-78046d731135): created successfully Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d4707a-3ce0-4cdc-9b97-017c443604b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Flow 'volume_create_manager' (06aa41ed-574e-4c4c-815e-e01094b91bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:20:26 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-712a8ca9-3f56-4c03-9254-d040bb9370f9 tempest-TestInstancesWithCinderVolumes-930911330 None] Created volume successfully. Jun 11 05:20:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Acquiring lock "cinder-a25f7139-ce95-40a1-9582-4c1283456993-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Lock "cinder-a25f7139-ce95-40a1-9582-4c1283456993-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Acquiring lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" acquired by "delete_snapshot" :: waited 0.042s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Acquiring lock "cinder-quobyte-a25f7139-ce95-40a1-9582-4c1283456993" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Lock "cinder-quobyte-a25f7139-ce95-40a1-9582-4c1283456993" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Deleting offline snapshot a25f7139-ce95-40a1-9582-4c1283456993 of volume 46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:20:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] snapshot_file for this snap is: volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:20:27 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3457fc5e-d9c3-4954-947b-b0c9cf2b21b7]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:27 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0 1073741824" returned: 0 in 1.414s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:27 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 Jun 11 05:20:27 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:27 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0 Jun 11 05:20:27 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:28 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993" returned: 0 in 1.026s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46edfea1-a80a-4268-8a14-88c815d4f25c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:20:28 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3432b99c-8e77-4cf3-a388-fd939fcb7f76]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:28 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0" returned: 0 in 0.944s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] <== create_volume: return (2421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:20:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.425s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f9d22e-03e0-45cf-8543-8f5e0f1dbaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b202c5c-12e5-42e6-9731-8b050c7afac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:28 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Volume volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0 (82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0): created successfully Jun 11 05:20:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b202c5c-12e5-42e6-9731-8b050c7afac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Flow 'volume_create_manager' (e282a6d0-aba2-456e-aed1-df661ea8afbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:20:28 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-60f661a6-c3a9-4ffd-bf37-aa40d0d90d93 tempest-TestInstancesWithCinderVolumes-930911330 None] Created volume successfully. Jun 11 05:20:28 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c Jun 11 05:20:28 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:29 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c" returned: 0 in 0.782s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:29 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 Jun 11 05:20:29 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:20:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:20:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:20:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:30 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:20:30 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:30 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993" returned: 0 in 0.919s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:30 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993 Jun 11 05:20:30 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:30 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD, size 20.69 MB, duration 4.92 sec {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 11 05:20:30 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Image download 20.69 MB at 4.20 MB/s Jun 11 05:20:30 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[81af2f69-0563-453d-a0e2-03185add173f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:31 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.807s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:20:31 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD Jun 11 05:20:31 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:31 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c.a25f7139-ce95-40a1-9582-4c1283456993" returned: 0 in 0.738s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Lock "cinder-quobyte-a25f7139-ce95-40a1-9582-4c1283456993" released by "_delete_snapshot" :: held 3.625s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" released by "delete_snapshot" :: held 3.662s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Created reservations ['0489f645-28cd-44c2-a8e6-48def6f0003a', 'a388dd0c-a0c5-48ff-90ac-1971f836d194', 'ad9a767b-358d-45a7-a15a-52e08ae83913', '03343184-6b62-48d2-a655-7f2d22345a7c'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:20:31 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Delete snapshot completed successfully. Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9abace59-e75f-4aaa-9641-9971f3d27f2f tempest-SnapshotsActionsTest-1260505501 None] Lock "cinder-a25f7139-ce95-40a1-9582-4c1283456993-delete_snapshot" released by "delete_snapshot" :: held 3.827s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:31 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD" returned: 0 in 0.851s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Temporary image 8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991 is fetched for user c5cdb711b1694d6dac12cdb12f0388fd. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[858a53d6-0d4a-42ca-9ea1-72c4e6904e2f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:31 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD Jun 11 05:20:31 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Acquiring lock "cinder-46edfea1-a80a-4268-8a14-88c815d4f25c-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Lock "cinder-46edfea1-a80a-4268-8a14-88c815d4f25c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Acquiring lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" acquired by "delete_volume" :: waited 0.031s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eebb32c-f695-40e4-a70c-02ddda3a7693]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:32 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c Jun 11 05:20:32 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:32 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD" returned: 0 in 0.968s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-243537444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8783d4cf-70c0-4cd9-9b53-e20973af042c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b605f43d2a4de0a8e8825aa6dd01f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:20:25Z,use_quota=True,user_id='c5cdb711b1694d6dac12cdb12f0388fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac555f23-216b-45c2-ac24-24d0c4888054),volume_type_id=ac555f23-216b-45c2-ac24-24d0c4888054)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Creating volume 8783d4cf-70c0-4cd9-9b53-e20973af042c {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:20:32 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:20:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:32 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c 1073741824 Jun 11 05:20:32 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:33 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c" returned: 0 in 1.050s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:33 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c Jun 11 05:20:33 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:34 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c 1073741824" returned: 0 in 1.191s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:34 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-46edfea1-a80a-4268-8a14-88c815d4f25c" returned: 0 in 0.909s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:34 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c Jun 11 05:20:34 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Lock "cinder-quobyte-46edfea1-a80a-4268-8a14-88c815d4f25c" released by "delete_volume" :: held 2.063s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Created reservations ['dfa98d94-5899-4baf-a2b9-22d62c469552', 'eb6fb35e-66dc-49cc-9562-b33c7df62574', '74639c73-5cea-42bb-9c77-1d1549388f3a', '0dd76a8c-6eee-4b6f-bafc-686f79ce7d59'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:34 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:20:34 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:34 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c" returned: 0 in 0.759s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Attempting download of 8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991 ((None, [{'url': 'file:///opt/stack/data/glance/images/8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991', 'metadata': {}}])) to volume 8783d4cf-70c0-4cd9-9b53-e20973af042c. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c5275e-5fe8-4864-83c5-5bc4a2208d82]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_cpbeuqvl {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:35 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.653s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:35 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:20:35 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Deleted volume successfully. Jun 11 05:20:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-39b45c51-08c2-42de-a330-1d3287768bbf tempest-SnapshotsActionsTest-1260505501 None] Lock "cinder-46edfea1-a80a-4268-8a14-88c815d4f25c-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:35 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_cpbeuqvl Jun 11 05:20:35 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:35 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_cpbeuqvl" returned: 0 in 0.848s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_cpbeuqvl {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:35 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_cpbeuqvl Jun 11 05:20:35 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Flow 'volume_create_manager' (2b431bee-0927-4f78-8d24-44f750667715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0fdf325-5422-4917-9da0-790b1d9895a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0fdf325-5422-4917-9da0-790b1d9895a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1975167723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d09795-4ae6-4cc7-83ad-0a494f034528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acb5471501a4a4299494bdad64a7847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:20:36Z,use_quota=True,user_id='a295079851df43149334038d59d20570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665dc512-3fd0-42c3-af0e-96a479f72985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665dc512-3fd0-42c3-af0e-96a479f72985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95d3cf8-1834-4418-ac55-d310a0613418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95d3cf8-1834-4418-ac55-d310a0613418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16d09795-4ae6-4cc7-83ad-0a494f034528', 'volume_name': 'volume-16d09795-4ae6-4cc7-83ad-0a494f034528', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3165930-79e5-49d6-a7f4-e5a9ee5f7edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3165930-79e5-49d6-a7f4-e5a9ee5f7edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe92e656-d0a5-4385-a992-92883146c98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:36 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Volume 16d09795-4ae6-4cc7-83ad-0a494f034528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16d09795-4ae6-4cc7-83ad-0a494f034528', 'volume_size': 1} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1975167723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d09795-4ae6-4cc7-83ad-0a494f034528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acb5471501a4a4299494bdad64a7847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:20:36Z,use_quota=True,user_id='a295079851df43149334038d59d20570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Creating volume 16d09795-4ae6-4cc7-83ad-0a494f034528 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:20:36 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:36 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 1073741824 Jun 11 05:20:36 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:36 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_cpbeuqvl" returned: 1 in 0.752s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_cpbeuqvl' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fd4310-e12d-4b06-83b7-d62fa92c6d57]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:36 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD Jun 11 05:20:36 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:37 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 1073741824" returned: 0 in 1.117s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:37 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD" returned: 0 in 0.942s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:37 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] 8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991 was qcow2, converting to raw {{(pid=92308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 11 05:20:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:37 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c Jun 11 05:20:37 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:37 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 Jun 11 05:20:37 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:38 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528" returned: 0 in 0.845s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:20:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe92e656-d0a5-4385-a992-92883146c98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d09795-4ae6-4cc7-83ad-0a494f034528', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0e4082-31a1-417d-afc4-b4236c1d2c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:38 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Volume volume-16d09795-4ae6-4cc7-83ad-0a494f034528 (16d09795-4ae6-4cc7-83ad-0a494f034528): created successfully Jun 11 05:20:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0e4082-31a1-417d-afc4-b4236c1d2c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Flow 'volume_create_manager' (2b431bee-0927-4f78-8d24-44f750667715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:20:38 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-263e5cde-eeff-4e44-bc58-a9efc7559867 tempest-TestStampPattern-272184299 None] Created volume successfully. Jun 11 05:20:39 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c" returned: 0 in 2.468s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:39 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991_zn0vh7b_devstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:20:39 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Converted 112.00 MB image at 45.36 MB/s Jun 11 05:20:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:40 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c 1G Jun 11 05:20:40 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:40 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c 1G" returned: 0 in 0.963s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:41 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[327d8857-6480-4d55-87e8-42129648d6d7]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:41 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c Jun 11 05:20:41 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:42 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c" returned: 0 in 1.045s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:42 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c Jun 11 05:20:42 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:43 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c" returned: 1 in 1.083s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:20:43 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Downloaded image 8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991 ((None, [{'url': 'file:///opt/stack/data/glance/images/8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991', 'metadata': {}}])) to volume 8783d4cf-70c0-4cd9-9b53-e20973af042c successfully. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 11 05:20:43 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Temporary image 8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991 for user c5cdb711b1694d6dac12cdb12f0388fd is deleted. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 11 05:20:43 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Marking volume 8783d4cf-70c0-4cd9-9b53-e20973af042c as bootable. {{(pid=92308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 11 05:20:43 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Copying metadata from image 8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991 to 8783d4cf-70c0-4cd9-9b53-e20973af042c. {{(pid=92308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 11 05:20:43 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Creating volume glance metadata for volume 8783d4cf-70c0-4cd9-9b53-e20973af042c backed by image 8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991 with: {'image_id': '8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991', 'image_name': 'tempest-scenario-img--837745623', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 11 05:20:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b64fa1e-316e-44ef-bf55-43d33280ddd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8783d4cf-70c0-4cd9-9b53-e20973af042c', 'volume_size': 1, 'image_id': '8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--837745623', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0b605f43d2a4de0a8e8825aa6dd01f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991', 'created_at': datetime.datetime(2026, 6, 11, 3, 20, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 20, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8eba2bf1-6dcf-4a3e-8bdc-8cb884f88991/file', 'properties': {}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455a7ea0-6df5-4f28-b63b-cd7d4607486a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:43 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Volume volume-8783d4cf-70c0-4cd9-9b53-e20973af042c (8783d4cf-70c0-4cd9-9b53-e20973af042c): created successfully Jun 11 05:20:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455a7ea0-6df5-4f28-b63b-cd7d4607486a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Flow 'volume_create_manager' (6b4b9626-a26c-4f42-8d7a-4604df57fbbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:20:43 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-786cd56f-52bd-4761-b641-3d000ef1dd29 tempest-TestInstancesWithCinderVolumes-930911330 None] Created volume successfully. Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Flow 'volume_create_manager' (352cd902-019a-4d90-a908-d01eea19ab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a4f9f8-94fd-4dab-8de7-4aacca3758f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a4f9f8-94fd-4dab-8de7-4aacca3758f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1754230368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e7faae-453c-4ddf-a51d-8209a0069280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390a12f77cc247ecb6864343a1dd1540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:20:52Z,use_quota=True,user_id='330b6d3aef9f4064a56ccef1aa8d6919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1674c41-41b9-4930-a330-78b41616df65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1674c41-41b9-4930-a330-78b41616df65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd094ab-8389-4339-a502-2802d191cde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd094ab-8389-4339-a502-2802d191cde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e7faae-453c-4ddf-a51d-8209a0069280', 'volume_name': 'volume-a1e7faae-453c-4ddf-a51d-8209a0069280', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7b6182-0367-4bdc-9eda-472e8c079e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7b6182-0367-4bdc-9eda-472e8c079e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9ade1d-e83e-477b-960d-cdfe7e920684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:51 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Volume a1e7faae-453c-4ddf-a51d-8209a0069280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e7faae-453c-4ddf-a51d-8209a0069280', 'volume_size': 1} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1754230368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e7faae-453c-4ddf-a51d-8209a0069280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390a12f77cc247ecb6864343a1dd1540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:20:52Z,use_quota=True,user_id='330b6d3aef9f4064a56ccef1aa8d6919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Creating volume a1e7faae-453c-4ddf-a51d-8209a0069280 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:20:51 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:20:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a1e7faae-453c-4ddf-a51d-8209a0069280 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:51 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a1e7faae-453c-4ddf-a51d-8209a0069280 1073741824 Jun 11 05:20:51 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:53 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a1e7faae-453c-4ddf-a51d-8209a0069280 1073741824" returned: 0 in 1.620s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a1e7faae-453c-4ddf-a51d-8209a0069280 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:53 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a1e7faae-453c-4ddf-a51d-8209a0069280 Jun 11 05:20:53 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:54 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a1e7faae-453c-4ddf-a51d-8209a0069280" returned: 0 in 1.255s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] <== create_volume: return (2996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:20:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9ade1d-e83e-477b-960d-cdfe7e920684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e7faae-453c-4ddf-a51d-8209a0069280', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6568147a-e6b1-4d2a-b344-7bd2d5d737cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:20:54 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Volume volume-a1e7faae-453c-4ddf-a51d-8209a0069280 (a1e7faae-453c-4ddf-a51d-8209a0069280): created successfully Jun 11 05:20:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6568147a-e6b1-4d2a-b344-7bd2d5d737cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:20:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Flow 'volume_create_manager' (352cd902-019a-4d90-a908-d01eea19ab4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:20:54 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5ff3cba0-a746-4640-be76-a2f70f45ba5c tempest-VolumesServicesTestJSON-762919546 None] Created volume successfully. Jun 11 05:20:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-c27d7176-b9d6-4d27-a21f-4b9a6f8eae86 req-49397745-ff40-40d5-a840-b6ac86aef614 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-c27d7176-b9d6-4d27-a21f-4b9a6f8eae86 req-49397745-ff40-40d5-a840-b6ac86aef614 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:55 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc7df16-7715-473b-9636-aa9617524bb2]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-c27d7176-b9d6-4d27-a21f-4b9a6f8eae86 req-49397745-ff40-40d5-a840-b6ac86aef614 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:55 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c Jun 11 05:20:55 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Acquiring lock "cinder-a1e7faae-453c-4ddf-a51d-8209a0069280-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Lock "cinder-a1e7faae-453c-4ddf-a51d-8209a0069280-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Acquiring lock "cinder-quobyte-a1e7faae-453c-4ddf-a51d-8209a0069280" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:20:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Lock "cinder-quobyte-a1e7faae-453c-4ddf-a51d-8209a0069280" acquired by "delete_volume" :: waited 0.026s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:20:55 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed13a68-e7e2-4754-8e09-5a8132d7a36b]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:20:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a1e7faae-453c-4ddf-a51d-8209a0069280 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:55 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a1e7faae-453c-4ddf-a51d-8209a0069280 Jun 11 05:20:55 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:56 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-c27d7176-b9d6-4d27-a21f-4b9a6f8eae86 req-49397745-ff40-40d5-a840-b6ac86aef614 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c" returned: 0 in 1.092s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-c27d7176-b9d6-4d27-a21f-4b9a6f8eae86 req-49397745-ff40-40d5-a840-b6ac86aef614 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:56 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c Jun 11 05:20:56 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:56 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a1e7faae-453c-4ddf-a51d-8209a0069280" returned: 0 in 0.910s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a1e7faae-453c-4ddf-a51d-8209a0069280 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:56 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a1e7faae-453c-4ddf-a51d-8209a0069280 Jun 11 05:20:56 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:57 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-c27d7176-b9d6-4d27-a21f-4b9a6f8eae86 req-49397745-ff40-40d5-a840-b6ac86aef614 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c" returned: 1 in 0.955s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-c27d7176-b9d6-4d27-a21f-4b9a6f8eae86 req-49397745-ff40-40d5-a840-b6ac86aef614 tempest-TestInstancesWithCinderVolumes-930911330 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:20:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-c27d7176-b9d6-4d27-a21f-4b9a6f8eae86 req-49397745-ff40-40d5-a840-b6ac86aef614 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.162s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-c27d7176-b9d6-4d27-a21f-4b9a6f8eae86 req-49397745-ff40-40d5-a840-b6ac86aef614 tempest-TestInstancesWithCinderVolumes-930911330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-8783d4cf-70c0-4cd9-9b53-e20973af042c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcd00d22-93c9-43d2-9cd8-38ecec0e59c6', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:20:57 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-c27d7176-b9d6-4d27-a21f-4b9a6f8eae86 req-49397745-ff40-40d5-a840-b6ac86aef614 tempest-TestInstancesWithCinderVolumes-930911330 None] attachment_update completed successfully. Jun 11 05:20:57 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a1e7faae-453c-4ddf-a51d-8209a0069280" returned: 0 in 0.854s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Lock "cinder-quobyte-a1e7faae-453c-4ddf-a51d-8209a0069280" released by "delete_volume" :: held 1.840s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:20:57 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Created reservations ['c9cfe8e4-d1f9-4cd2-987f-2460657e0147', 'f9891234-2af3-4da1-afb0-46ab59af97b5', '3c5459e3-7dd7-4c86-a583-cc6b381d895e', '9e1811ac-4908-41ca-a16a-420c65756a4f'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:20:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:20:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:20:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:20:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:20:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:20:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:20:57 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:20:57 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:20:58 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jun 11 05:20:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.103s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:20:58 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:20:58 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Deleted volume successfully. Jun 11 05:20:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-45f8c524-f587-4846-b861-bbc7f83d5b89 tempest-VolumesServicesTestJSON-762919546 None] Lock "cinder-a1e7faae-453c-4ddf-a51d-8209a0069280-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Flow 'volume_create_manager' (132ad1a2-7202-4263-8556-0fa9ac3471a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae892ba-dd7d-4726-a14b-80a361cb7a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae892ba-dd7d-4726-a14b-80a361cb7a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-608841381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9eb988f-f68b-4d38-b1ec-52e53a15835a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b063a728f5394bac8d11106ec41692dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:06Z,use_quota=True,user_id='408684919f9340eeaba904c259409ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b04c1584-f398-4a98-b899-ce13b08dc0cc),volume_type_id=b04c1584-f398-4a98-b899-ce13b08dc0cc)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c30dda5-2b18-427e-acab-24f6cacd7bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c30dda5-2b18-427e-acab-24f6cacd7bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0557d88f-bcdd-4aed-8a3e-1d464f95be7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0557d88f-bcdd-4aed-8a3e-1d464f95be7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9eb988f-f68b-4d38-b1ec-52e53a15835a', 'volume_name': 'volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae1c717-589c-4f7b-a49a-dbf1ec6d4262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae1c717-589c-4f7b-a49a-dbf1ec6d4262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904fa37d-88fe-400f-a462-d74003e349e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:06 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Volume e9eb988f-f68b-4d38-b1ec-52e53a15835a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a', 'volume_size': 1} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-608841381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9eb988f-f68b-4d38-b1ec-52e53a15835a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b063a728f5394bac8d11106ec41692dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:06Z,use_quota=True,user_id='408684919f9340eeaba904c259409ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b04c1584-f398-4a98-b899-ce13b08dc0cc),volume_type_id=b04c1584-f398-4a98-b899-ce13b08dc0cc)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Creating volume e9eb988f-f68b-4d38-b1ec-52e53a15835a {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:21:06 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:21:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:06 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a 1073741824 Jun 11 05:21:06 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:07 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a 1073741824" returned: 0 in 1.203s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:07 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a Jun 11 05:21:07 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:08 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a" returned: 0 in 0.632s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:08 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:21:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904fa37d-88fe-400f-a462-d74003e349e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85cc42c-ef57-4039-9424-9b57d1a26345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:08 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Volume volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a (e9eb988f-f68b-4d38-b1ec-52e53a15835a): created successfully Jun 11 05:21:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85cc42c-ef57-4039-9424-9b57d1a26345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:08 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Flow 'volume_create_manager' (132ad1a2-7202-4263-8556-0fa9ac3471a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:08 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-ae91c800-b790-4801-a65e-0e4d24f6161f tempest-VolumeTypesAccessTest-1684832608 None] Created volume successfully. Jun 11 05:21:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Acquiring lock "cinder-e9eb988f-f68b-4d38-b1ec-52e53a15835a-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Lock "cinder-e9eb988f-f68b-4d38-b1ec-52e53a15835a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Acquiring lock "cinder-quobyte-e9eb988f-f68b-4d38-b1ec-52e53a15835a" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Lock "cinder-quobyte-e9eb988f-f68b-4d38-b1ec-52e53a15835a" acquired by "delete_volume" :: waited 0.036s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebc1f90-706d-4973-9643-d55fc80df92a]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:09 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a Jun 11 05:21:09 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Flow 'volume_create_manager' (2659275f-d93f-4fd7-89ee-2b7a748cfa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac38aa27-a9f2-4783-9c9a-ccb994ec7fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac38aa27-a9f2-4783-9c9a-ccb994ec7fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1089107853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b08729-945f-4e51-bc9f-6341b66a97c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d18a39d02875433086d5f91c14ed92a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:09Z,use_quota=True,user_id='fb06bed8ad484f9792ccca64e542e62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c5c2ae-163e-4ada-8311-f222eea25376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c5c2ae-163e-4ada-8311-f222eea25376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1966aa19-56a5-4c8d-89fb-456b83bdf00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1966aa19-56a5-4c8d-89fb-456b83bdf00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97b08729-945f-4e51-bc9f-6341b66a97c5', 'volume_name': 'volume-97b08729-945f-4e51-bc9f-6341b66a97c5', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1365c802-e615-4f6c-ae8b-363b4e26f477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1365c802-e615-4f6c-ae8b-363b4e26f477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a949a4f9-cfab-4b23-a8cd-7a6a646110f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:09 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Volume 97b08729-945f-4e51-bc9f-6341b66a97c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97b08729-945f-4e51-bc9f-6341b66a97c5', 'volume_size': 1} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1089107853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b08729-945f-4e51-bc9f-6341b66a97c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d18a39d02875433086d5f91c14ed92a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:09Z,use_quota=True,user_id='fb06bed8ad484f9792ccca64e542e62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Creating volume 97b08729-945f-4e51-bc9f-6341b66a97c5 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:21:09 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:09 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5 1073741824 Jun 11 05:21:09 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:09 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a" returned: 0 in 0.876s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:09 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a Jun 11 05:21:09 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:10 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5 1073741824" returned: 0 in 1.265s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:10 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9eb988f-f68b-4d38-b1ec-52e53a15835a" returned: 0 in 0.852s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:10 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5 Jun 11 05:21:10 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Lock "cinder-quobyte-e9eb988f-f68b-4d38-b1ec-52e53a15835a" released by "delete_volume" :: held 1.799s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:10 devstack cinder-volume[92308]: WARNING cinder.quota [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-828372760 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-828372760, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:21:10 devstack cinder-volume[92308]: WARNING cinder.quota [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-828372760 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-828372760, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:21:10 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Created reservations ['7e07d37f-1344-4cb5-93c7-09927a1957a6', '162c5148-b0cc-4f76-919a-2ffdb2843cf8', 'b848484c-2c10-47b8-b309-cafb8f9dfffb', '601ee0bb-be1c-4b5c-9934-f1601f62e766'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:21:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:11 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:21:11 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:12 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5" returned: 0 in 1.399s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] <== create_volume: return (2719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:21:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.727s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a949a4f9-cfab-4b23-a8cd-7a6a646110f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97b08729-945f-4e51-bc9f-6341b66a97c5', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c4bb86-ddfb-4e5a-a043-be468d12edd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:12 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Volume volume-97b08729-945f-4e51-bc9f-6341b66a97c5 (97b08729-945f-4e51-bc9f-6341b66a97c5): created successfully Jun 11 05:21:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c4bb86-ddfb-4e5a-a043-be468d12edd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:12 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Flow 'volume_create_manager' (2659275f-d93f-4fd7-89ee-2b7a748cfa8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:12 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9240cc8b-ae98-49c2-8b8a-7c9a89ba219c tempest-AttachVolumeNegativeTest-1997665377 None] Created volume successfully. Jun 11 05:21:12 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.412s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:12 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:21:12 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Deleted volume successfully. Jun 11 05:21:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c228134a-9068-4d68-9985-df26ee4a501a tempest-VolumeTypesAccessTest-1684832608 None] Lock "cinder-e9eb988f-f68b-4d38-b1ec-52e53a15835a-delete_volume" released by "delete_volume" :: held 3.580s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-d2c8cfe9-0402-43b6-b732-f1f5095683ae req-a5aef60c-125b-435c-b553-94a7feae53be tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-d2c8cfe9-0402-43b6-b732-f1f5095683ae req-a5aef60c-125b-435c-b553-94a7feae53be tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:16 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fec60b-d390-4533-83a2-6a5cd9414d18]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-d2c8cfe9-0402-43b6-b732-f1f5095683ae req-a5aef60c-125b-435c-b553-94a7feae53be tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:16 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5 Jun 11 05:21:16 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:17 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-d2c8cfe9-0402-43b6-b732-f1f5095683ae req-a5aef60c-125b-435c-b553-94a7feae53be tempest-AttachVolumeNegativeTest-1997665377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5" returned: 0 in 0.776s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-d2c8cfe9-0402-43b6-b732-f1f5095683ae req-a5aef60c-125b-435c-b553-94a7feae53be tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.795s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-d2c8cfe9-0402-43b6-b732-f1f5095683ae req-a5aef60c-125b-435c-b553-94a7feae53be tempest-AttachVolumeNegativeTest-1997665377 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-97b08729-945f-4e51-bc9f-6341b66a97c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50edd4f5-af1c-4c20-9d4d-ad6714716292', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:21:17 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-d2c8cfe9-0402-43b6-b732-f1f5095683ae req-a5aef60c-125b-435c-b553-94a7feae53be tempest-AttachVolumeNegativeTest-1997665377 None] attachment_update completed successfully. Jun 11 05:21:23 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-1ab0df30-d860-442f-a411-9a8f76864b73 req-fadd8bdd-254d-4f9f-a0f7-eb095c627ed3 tempest-AttachVolumeNegativeTest-1997665377 None] Terminate volume connection completed successfully. Jun 11 05:21:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-1ab0df30-d860-442f-a411-9a8f76864b73 req-fadd8bdd-254d-4f9f-a0f7-eb095c627ed3 tempest-AttachVolumeNegativeTest-1997665377 None] Deleting attachment 50edd4f5-af1c-4c20-9d4d-ad6714716292. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:21:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-fe9fc4fc-eaef-4e52-b623-e5f875eab178 req-a372b21b-701d-4ba0-8325-8fc8028c62ef tempest-TestStampPattern-272184299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-fe9fc4fc-eaef-4e52-b623-e5f875eab178 req-a372b21b-701d-4ba0-8325-8fc8028c62ef tempest-TestStampPattern-272184299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:23 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c94db19-9670-49f8-a39f-73a46c996b77]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-fe9fc4fc-eaef-4e52-b623-e5f875eab178 req-a372b21b-701d-4ba0-8325-8fc8028c62ef tempest-TestStampPattern-272184299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:23 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 Jun 11 05:21:23 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:24 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-fe9fc4fc-eaef-4e52-b623-e5f875eab178 req-a372b21b-701d-4ba0-8325-8fc8028c62ef tempest-TestStampPattern-272184299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528" returned: 0 in 0.720s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-fe9fc4fc-eaef-4e52-b623-e5f875eab178 req-a372b21b-701d-4ba0-8325-8fc8028c62ef tempest-TestStampPattern-272184299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.748s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-fe9fc4fc-eaef-4e52-b623-e5f875eab178 req-a372b21b-701d-4ba0-8325-8fc8028c62ef tempest-TestStampPattern-272184299 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-16d09795-4ae6-4cc7-83ad-0a494f034528', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb38906a-9964-4388-b97b-631a27a3f33b', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:21:24 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-fe9fc4fc-eaef-4e52-b623-e5f875eab178 req-a372b21b-701d-4ba0-8325-8fc8028c62ef tempest-TestStampPattern-272184299 None] attachment_update completed successfully. Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Flow 'volume_create_manager' (d23f48c1-6364-4103-b0f8-8c8b6ba93625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec678c3b-4651-4f11-9b43-65da84c0343f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec678c3b-4651-4f11-9b43-65da84c0343f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-929409380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5f596d-fd04-4a10-9bbe-bedcc8984e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e666de606244f9819c01e326d049d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:25Z,use_quota=True,user_id='94aa76d39d024e83872936b3c85ae56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f911cc-4d70-4c6d-84b6-1a17ad6e3965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f911cc-4d70-4c6d-84b6-1a17ad6e3965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fdcb7c-9299-46e7-af0f-df4fe8b81bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fdcb7c-9299-46e7-af0f-df4fe8b81bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b5f596d-fd04-4a10-9bbe-bedcc8984e5d', 'volume_name': 'volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb1e6ec-7cd7-4dd1-bae4-5ec7037dd4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb1e6ec-7cd7-4dd1-bae4-5ec7037dd4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8466cc-d892-4dc0-aca5-c008206a9ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:24 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Volume 1b5f596d-fd04-4a10-9bbe-bedcc8984e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d', 'volume_size': 1} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-929409380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5f596d-fd04-4a10-9bbe-bedcc8984e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e666de606244f9819c01e326d049d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:25Z,use_quota=True,user_id='94aa76d39d024e83872936b3c85ae56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Creating volume 1b5f596d-fd04-4a10-9bbe-bedcc8984e5d {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:21:24 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:21:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:24 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d 1073741824 Jun 11 05:21:24 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:25 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d 1073741824" returned: 0 in 0.878s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:25 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=64,cinder:UPDATE=55,cinder:INSERT=18,cinder:DELETE=8 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:21:25 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=69,cinder:SELECT=59,cinder:INSERT=18,cinder:DELETE=2 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:21:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:25 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d Jun 11 05:21:25 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:26 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d" returned: 0 in 0.704s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:21:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8466cc-d892-4dc0-aca5-c008206a9ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b79625-d83a-46f7-af29-358a1e8518d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:26 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Volume volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d (1b5f596d-fd04-4a10-9bbe-bedcc8984e5d): created successfully Jun 11 05:21:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b79625-d83a-46f7-af29-358a1e8518d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Flow 'volume_create_manager' (d23f48c1-6364-4103-b0f8-8c8b6ba93625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:26 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3ef0cae6-fbb1-425b-a317-2a41e9ec1856 tempest-VolumesListAdminTestJSON-2011971914 None] Created volume successfully. Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Flow 'volume_create_manager' (f224b38a-f321-46c1-b967-417aed3a10d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f0140e-d027-4162-858d-91e5ef5002a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f0140e-d027-4162-858d-91e5ef5002a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-584742274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7b775b-b47a-45f0-8c4b-946519449312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e666de606244f9819c01e326d049d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:27Z,use_quota=True,user_id='94aa76d39d024e83872936b3c85ae56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd0f787-1286-429b-91c3-67feb99a6145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd0f787-1286-429b-91c3-67feb99a6145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4481940f-d250-4e29-a854-724924f1d6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4481940f-d250-4e29-a854-724924f1d6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7b775b-b47a-45f0-8c4b-946519449312', 'volume_name': 'volume-ff7b775b-b47a-45f0-8c4b-946519449312', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bad038f-81ec-4401-b204-2f214bdd19b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bad038f-81ec-4401-b204-2f214bdd19b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d8434a-5502-437f-9ed0-ea39af4d9278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:27 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Volume ff7b775b-b47a-45f0-8c4b-946519449312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7b775b-b47a-45f0-8c4b-946519449312', 'volume_size': 1} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-584742274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7b775b-b47a-45f0-8c4b-946519449312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e666de606244f9819c01e326d049d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:27Z,use_quota=True,user_id='94aa76d39d024e83872936b3c85ae56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Creating volume ff7b775b-b47a-45f0-8c4b-946519449312 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:21:27 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:21:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ff7b775b-b47a-45f0-8c4b-946519449312 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:27 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ff7b775b-b47a-45f0-8c4b-946519449312 1073741824 Jun 11 05:21:27 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:28 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ff7b775b-b47a-45f0-8c4b-946519449312 1073741824" returned: 0 in 1.026s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ff7b775b-b47a-45f0-8c4b-946519449312 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:28 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ff7b775b-b47a-45f0-8c4b-946519449312 Jun 11 05:21:28 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:29 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ff7b775b-b47a-45f0-8c4b-946519449312" returned: 0 in 0.675s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:21:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d8434a-5502-437f-9ed0-ea39af4d9278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7b775b-b47a-45f0-8c4b-946519449312', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22267e4d-d3c0-4faf-9d35-69d1b4441fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:29 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Volume volume-ff7b775b-b47a-45f0-8c4b-946519449312 (ff7b775b-b47a-45f0-8c4b-946519449312): created successfully Jun 11 05:21:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22267e4d-d3c0-4faf-9d35-69d1b4441fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Flow 'volume_create_manager' (f224b38a-f321-46c1-b967-417aed3a10d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:29 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-202580fa-cdf8-4f7f-b483-094605a5693e tempest-VolumesListAdminTestJSON-2011971914 None] Created volume successfully. Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Flow 'volume_create_manager' (d1ebc12b-019f-4f65-bcfb-69858a8226e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52796fd8-69e4-4a4d-821a-4efe9b01b539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52796fd8-69e4-4a4d-821a-4efe9b01b539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1101489911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975c161c-1545-465c-8cf4-26efcc437b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e666de606244f9819c01e326d049d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:30Z,use_quota=True,user_id='94aa76d39d024e83872936b3c85ae56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20934fad-fa05-4035-a26d-decf432dc561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20934fad-fa05-4035-a26d-decf432dc561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dedbe8f-ce4e-4f5c-90c9-db2d24f1115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dedbe8f-ce4e-4f5c-90c9-db2d24f1115e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '975c161c-1545-465c-8cf4-26efcc437b1c', 'volume_name': 'volume-975c161c-1545-465c-8cf4-26efcc437b1c', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7201ae-7880-4497-8715-8769c1c2c85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7201ae-7880-4497-8715-8769c1c2c85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88ed335-36a1-4844-8570-a6b263a233e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:30 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Volume 975c161c-1545-465c-8cf4-26efcc437b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-975c161c-1545-465c-8cf4-26efcc437b1c', 'volume_size': 1} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1101489911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975c161c-1545-465c-8cf4-26efcc437b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e666de606244f9819c01e326d049d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:30Z,use_quota=True,user_id='94aa76d39d024e83872936b3c85ae56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Creating volume 975c161c-1545-465c-8cf4-26efcc437b1c {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:21:30 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-975c161c-1545-465c-8cf4-26efcc437b1c 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:30 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-975c161c-1545-465c-8cf4-26efcc437b1c 1073741824 Jun 11 05:21:30 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:30 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:21:30 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:30 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.702s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:21:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:21:31 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-975c161c-1545-465c-8cf4-26efcc437b1c 1073741824" returned: 0 in 0.900s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-975c161c-1545-465c-8cf4-26efcc437b1c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:31 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-975c161c-1545-465c-8cf4-26efcc437b1c Jun 11 05:21:31 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:31 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-975c161c-1545-465c-8cf4-26efcc437b1c" returned: 0 in 0.624s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:21:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88ed335-36a1-4844-8570-a6b263a233e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-975c161c-1545-465c-8cf4-26efcc437b1c', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e8f272-968b-405e-93cd-4e46717d4ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:31 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Volume volume-975c161c-1545-465c-8cf4-26efcc437b1c (975c161c-1545-465c-8cf4-26efcc437b1c): created successfully Jun 11 05:21:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e8f272-968b-405e-93cd-4e46717d4ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Flow 'volume_create_manager' (d1ebc12b-019f-4f65-bcfb-69858a8226e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:31 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c1138e85-df4c-476e-9459-312e5f6647d3 tempest-VolumesListAdminTestJSON-2011971914 None] Created volume successfully. Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Flow 'volume_create_manager' (74c0ff26-54eb-43c0-bb98-928b9cd814b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ab1580-abf1-48db-a6c5-d10115007872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ab1580-abf1-48db-a6c5-d10115007872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a6b09d-b36c-477e-873f-a276fc1288e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839168d4782d4d64804e8fc715f0417b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:33Z,use_quota=True,user_id='5566b40678e44c2d84e67343c2027a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92c8602-44ae-4542-bde6-814afe3cbfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92c8602-44ae-4542-bde6-814afe3cbfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ea832a-2e8f-46fc-9100-e4060261909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ea832a-2e8f-46fc-9100-e4060261909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a6b09d-b36c-477e-873f-a276fc1288e2', 'volume_name': 'volume-a6a6b09d-b36c-477e-873f-a276fc1288e2', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1377784a-9dc3-4e95-8f4b-aa880ea5c07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1377784a-9dc3-4e95-8f4b-aa880ea5c07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3222c0a4-6ea6-4fd4-b3a9-86242f1316fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:32 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Volume a6a6b09d-b36c-477e-873f-a276fc1288e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a6b09d-b36c-477e-873f-a276fc1288e2', 'volume_size': 1} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a6b09d-b36c-477e-873f-a276fc1288e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839168d4782d4d64804e8fc715f0417b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:33Z,use_quota=True,user_id='5566b40678e44c2d84e67343c2027a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Creating volume a6a6b09d-b36c-477e-873f-a276fc1288e2 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:21:32 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:21:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a6a6b09d-b36c-477e-873f-a276fc1288e2 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:32 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a6a6b09d-b36c-477e-873f-a276fc1288e2 1073741824 Jun 11 05:21:32 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:33 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-7b279f8b-506b-44d4-8e8b-cd9422a4aa1e req-b9a51b16-3428-42d5-89ac-b739aa5deb91 tempest-TestStampPattern-272184299 None] Terminate volume connection completed successfully. Jun 11 05:21:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-7b279f8b-506b-44d4-8e8b-cd9422a4aa1e req-b9a51b16-3428-42d5-89ac-b739aa5deb91 tempest-TestStampPattern-272184299 None] Deleting attachment bb38906a-9964-4388-b97b-631a27a3f33b. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:21:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "cinder-97b08729-945f-4e51-bc9f-6341b66a97c5-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Lock "cinder-97b08729-945f-4e51-bc9f-6341b66a97c5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:33 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a6a6b09d-b36c-477e-873f-a276fc1288e2 1073741824" returned: 0 in 0.901s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "cinder-quobyte-97b08729-945f-4e51-bc9f-6341b66a97c5" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Lock "cinder-quobyte-97b08729-945f-4e51-bc9f-6341b66a97c5" acquired by "delete_volume" :: waited 0.024s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a6a6b09d-b36c-477e-873f-a276fc1288e2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:33 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1df1c8-71de-4c94-9671-3b94b6ffdfc9]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:33 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a6a6b09d-b36c-477e-873f-a276fc1288e2 Jun 11 05:21:33 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:33 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5 Jun 11 05:21:33 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:34 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a6a6b09d-b36c-477e-873f-a276fc1288e2" returned: 0 in 0.621s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:34 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:21:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3222c0a4-6ea6-4fd4-b3a9-86242f1316fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a6b09d-b36c-477e-873f-a276fc1288e2', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fbd388-e086-4053-b6bc-c8be3bd620b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:34 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Volume volume-a6a6b09d-b36c-477e-873f-a276fc1288e2 (a6a6b09d-b36c-477e-873f-a276fc1288e2): created successfully Jun 11 05:21:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fbd388-e086-4053-b6bc-c8be3bd620b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Flow 'volume_create_manager' (74c0ff26-54eb-43c0-bb98-928b9cd814b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:34 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-d92622eb-46c1-408e-8d9d-8f91fa69e420 tempest-VolumesListAdminTestJSON-378559148 None] Created volume successfully. Jun 11 05:21:34 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5" returned: 0 in 0.795s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:34 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5 Jun 11 05:21:34 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Acquiring lock "cinder-a6a6b09d-b36c-477e-873f-a276fc1288e2-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Lock "cinder-a6a6b09d-b36c-477e-873f-a276fc1288e2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Acquiring lock "cinder-quobyte-a6a6b09d-b36c-477e-873f-a276fc1288e2" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Lock "cinder-quobyte-a6a6b09d-b36c-477e-873f-a276fc1288e2" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a851bd9-c982-4b8d-9326-d91579b00bfa]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a6a6b09d-b36c-477e-873f-a276fc1288e2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "cinder-975c161c-1545-465c-8cf4-26efcc437b1c-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "cinder-975c161c-1545-465c-8cf4-26efcc437b1c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:35 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-97b08729-945f-4e51-bc9f-6341b66a97c5" returned: 0 in 0.649s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "cinder-quobyte-975c161c-1545-465c-8cf4-26efcc437b1c" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Lock "cinder-quobyte-97b08729-945f-4e51-bc9f-6341b66a97c5" released by "delete_volume" :: held 1.505s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "cinder-quobyte-975c161c-1545-465c-8cf4-26efcc437b1c" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b2ade4-f0b2-4bec-a3a5-a47c4c3db5be]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:35 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a6a6b09d-b36c-477e-873f-a276fc1288e2 Jun 11 05:21:35 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-975c161c-1545-465c-8cf4-26efcc437b1c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Created reservations ['ff937316-0815-4742-b512-f9743bce4d30', 'b5477627-6625-407d-9865-6f6ed21e87e1', '8fe667f7-4e0b-4032-a38f-bb8e776c17dc', 'b0e6333f-86dd-4d8a-b67a-f91d1d05c7a7'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:35 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-975c161c-1545-465c-8cf4-26efcc437b1c Jun 11 05:21:35 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:35 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:21:35 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] Creating offline snapshot 59e417ba-413e-4b7e-82cb-8a2c678a1d24 of volume 16d09795-4ae6-4cc7-83ad-0a494f034528 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[014ac3c5-0e53-4428-9f7b-fe6c8524f1e7]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:35 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 Jun 11 05:21:35 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "cinder-63b48a88-91b8-400a-a9a9-50bd8415c59e-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "cinder-63b48a88-91b8-400a-a9a9-50bd8415c59e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:36 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a6a6b09d-b36c-477e-873f-a276fc1288e2" returned: 0 in 1.050s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a6a6b09d-b36c-477e-873f-a276fc1288e2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "cinder-quobyte-63b48a88-91b8-400a-a9a9-50bd8415c59e" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:36 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a6a6b09d-b36c-477e-873f-a276fc1288e2 Jun 11 05:21:36 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:36 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "cinder-quobyte-63b48a88-91b8-400a-a9a9-50bd8415c59e" acquired by "delete_volume" :: waited 0.038s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.863s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:21:36 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Deleted volume successfully. Jun 11 05:21:36 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-975c161c-1545-465c-8cf4-26efcc437b1c" returned: 0 in 1.011s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-975c161c-1545-465c-8cf4-26efcc437b1c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0985fd9-bc89-4e36-856f-69361764855d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:36 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-975c161c-1545-465c-8cf4-26efcc437b1c Jun 11 05:21:36 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5a3d9fe7-c3dc-435b-8732-fe4d56b9338d tempest-AttachVolumeNegativeTest-1997665377 None] Lock "cinder-97b08729-945f-4e51-bc9f-6341b66a97c5-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:36 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e Jun 11 05:21:36 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:36 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528" returned: 0 in 0.858s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:36 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 1G Jun 11 05:21:36 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:37 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-a6a6b09d-b36c-477e-873f-a276fc1288e2" returned: 0 in 0.787s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Lock "cinder-quobyte-a6a6b09d-b36c-477e-873f-a276fc1288e2" released by "delete_volume" :: held 1.899s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Created reservations ['794ba890-08c9-437c-9935-e4920df12b02', '3e98aee3-e73d-4743-b4e9-bc3d7859d38f', 'ab0f8628-3b55-493b-af95-593dbeb87b8b', 'fb71de71-506b-4831-b6c5-98700eac2243'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:21:37 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-975c161c-1545-465c-8cf4-26efcc437b1c" returned: 0 in 0.822s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "cinder-quobyte-975c161c-1545-465c-8cf4-26efcc437b1c" released by "delete_volume" :: held 1.889s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:37 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e" returned: 0 in 0.897s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:37 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:37 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Created reservations ['9c42d16a-419c-4ba2-8d3c-aa33c2d1b20a', '2197bd18-617f-487f-9b18-8a43ae11bff8', 'a2163662-f903-47ff-91b4-e0ec8cac2c24', 'ecbd3e8b-a4a4-433e-a4ab-a08737ed1b42'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:21:37 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:21:37 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:37 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:21:37 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "cinder-ff7b775b-b47a-45f0-8c4b-946519449312-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Lock "cinder-ff7b775b-b47a-45f0-8c4b-946519449312-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "cinder-quobyte-ff7b775b-b47a-45f0-8c4b-946519449312" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Lock "cinder-quobyte-ff7b775b-b47a-45f0-8c4b-946519449312" acquired by "delete_volume" :: waited 0.040s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[09361dac-8e94-4fce-9e63-e8432043ebbf]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ff7b775b-b47a-45f0-8c4b-946519449312 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:38 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ff7b775b-b47a-45f0-8c4b-946519449312 Jun 11 05:21:38 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:38 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 1G" returned: 0 in 1.376s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d09795-4ae6-4cc7-83ad-0a494f034528 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:38 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d09795-4ae6-4cc7-83ad-0a494f034528 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 Jun 11 05:21:38 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:38 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-63b48a88-91b8-400a-a9a9-50bd8415c59e" returned: 0 in 0.811s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "cinder-quobyte-63b48a88-91b8-400a-a9a9-50bd8415c59e" released by "delete_volume" :: held 1.800s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Created reservations ['476770cb-06f3-4b3f-a3af-2f55161f4602', '34e9151e-b593-4db9-a9b5-3f3090ef2bd8', 'abfb9866-579a-4b8b-bc47-6edd5dd1cdd7', '602f94f2-c520-4d84-99e2-e8ba8c32db01'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-ae10896e-b530-4523-84f5-f0bdbeb99cc5 req-01f02c95-54e3-4e38-9c7b-3590e3a99c17 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:38 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.837s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:21:38 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Deleted volume successfully. Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-27531cd1-7bf2-4893-a80c-ab8f7082bd41 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "cinder-975c161c-1545-465c-8cf4-26efcc437b1c-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:38 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:21:38 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:38 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.248s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:21:38 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Deleted volume successfully. Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a146f6b5-5c89-4a94-8cff-0c4d44d661d0 tempest-VolumesListAdminTestJSON-378559148 None] Lock "cinder-a6a6b09d-b36c-477e-873f-a276fc1288e2-delete_volume" released by "delete_volume" :: held 3.538s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "cinder-b6b99600-0610-4f2a-8d83-3c8c70bef77f-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "cinder-b6b99600-0610-4f2a-8d83-3c8c70bef77f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "cinder-quobyte-b6b99600-0610-4f2a-8d83-3c8c70bef77f" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "cinder-quobyte-b6b99600-0610-4f2a-8d83-3c8c70bef77f" acquired by "delete_volume" :: waited 0.025s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ed714e-8ee9-48a6-9aaa-7f822f362600]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:38 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ff7b775b-b47a-45f0-8c4b-946519449312" returned: 0 in 1.152s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ff7b775b-b47a-45f0-8c4b-946519449312 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:39 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ff7b775b-b47a-45f0-8c4b-946519449312 Jun 11 05:21:39 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:39 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f Jun 11 05:21:39 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:39 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16d09795-4ae6-4cc7-83ad-0a494f034528 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24" returned: 0 in 1.037s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:39 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 is being set with open permissions: ugo+rw Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:39 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 Jun 11 05:21:39 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:39 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.793s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:21:39 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Deleted volume successfully. Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-61ff2a1e-974f-4eba-a5b1-915644a93464 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "cinder-63b48a88-91b8-400a-a9a9-50bd8415c59e-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:39 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f" returned: 0 in 0.741s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:39 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ff7b775b-b47a-45f0-8c4b-946519449312" returned: 0 in 0.675s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:39 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Lock "cinder-quobyte-ff7b775b-b47a-45f0-8c4b-946519449312" released by "delete_volume" :: held 1.883s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:39 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:39 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24" returned: 0 in 0.640s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Created reservations ['866793eb-7440-4e10-bbc3-b6962b97944c', '02d1dbb1-6d85-4843-8a98-52b01b64c7d2', 'f2f5695f-3f17-4b55-83ee-7e5952c44b1f', 'a158c26f-7db7-4d0f-be30-c556f37ebbb9'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:21:39 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.info Jun 11 05:21:39 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:39 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:21:39 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "cinder-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "cinder-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "cinder-quobyte-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "cinder-quobyte-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d" acquired by "delete_volume" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[402f626d-5542-4daa-bc9c-7f40e3ce248e]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:40 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d Jun 11 05:21:40 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:40 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b6b99600-0610-4f2a-8d83-3c8c70bef77f" returned: 0 in 0.757s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "cinder-quobyte-b6b99600-0610-4f2a-8d83-3c8c70bef77f" released by "delete_volume" :: held 1.543s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:40 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.info" returned: 0 in 0.716s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:40 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.info is being set with open permissions: ugo+rw Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:40 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.info Jun 11 05:21:40 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Created reservations ['aacfa71c-ecaf-4d52-b806-540623734daf', '1ffc7f83-cf51-4d50-81c8-6c0342333ca0', '7eec68a1-a31b-4ef8-a6cf-aa0e4e5fefe1', 'b8ac4033-6d76-40c7-8c73-5f56c709e01e'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:40 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.780s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:21:40 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Deleted volume successfully. Jun 11 05:21:40 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:21:40 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e52df7e1-0f8f-42d0-94fc-8ed5528a76cd tempest-VolumesListAdminTestJSON-2011971914 None] Lock "cinder-ff7b775b-b47a-45f0-8c4b-946519449312-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:41 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d" returned: 0 in 0.835s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:41 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.info" returned: 0 in 0.642s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:41 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d Jun 11 05:21:41 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.400s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-ae10896e-b530-4523-84f5-f0bdbeb99cc5 req-01f02c95-54e3-4e38-9c7b-3590e3a99c17 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.871s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ba42f1-5fda-4c57-936b-e57e30ae7970]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-ae10896e-b530-4523-84f5-f0bdbeb99cc5 req-01f02c95-54e3-4e38-9c7b-3590e3a99c17 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:41 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-af603c1e-f43f-42b3-a63f-714a8959dbf2 tempest-TestStampPattern-272184299 None] Create snapshot completed successfully Jun 11 05:21:41 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135 Jun 11 05:21:41 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:41 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.792s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:21:41 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Deleted volume successfully. Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-97e57cc7-186b-438d-911c-4c7957c6e828 tempest-AttachVolumeNegativeTest-1997665377 None] Lock "cinder-b6b99600-0610-4f2a-8d83-3c8c70bef77f-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:41 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d" returned: 0 in 0.744s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "cinder-quobyte-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d" released by "delete_volume" :: held 1.642s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Created reservations ['573ed254-052c-4520-9716-5f13d1881015', 'cb7805a0-0a2d-46a1-a7fa-c2267bd4ee3a', '3f56f7ca-f31d-4af4-8fc8-32587ce139f9', 'd615261a-345a-44c7-a4e5-4a084fab996f'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:21:41 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-ae10896e-b530-4523-84f5-f0bdbeb99cc5 req-01f02c95-54e3-4e38-9c7b-3590e3a99c17 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135" returned: 0 in 0.746s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-ae10896e-b530-4523-84f5-f0bdbeb99cc5 req-01f02c95-54e3-4e38-9c7b-3590e3a99c17 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.825s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-ae10896e-b530-4523-84f5-f0bdbeb99cc5 req-01f02c95-54e3-4e38-9c7b-3590e3a99c17 tempest-TestInstancesWithCinderVolumes-930911330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-96bcc8e4-338e-4ef3-bccd-78046d731135', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4acc7332-ebac-49b0-b103-6c6104c9e02b', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:21:42 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:21:42 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:42 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-ae10896e-b530-4523-84f5-f0bdbeb99cc5 req-01f02c95-54e3-4e38-9c7b-3590e3a99c17 tempest-TestInstancesWithCinderVolumes-930911330 None] attachment_update completed successfully. Jun 11 05:21:42 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.734s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:42 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:21:42 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Deleted volume successfully. Jun 11 05:21:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c69bc0fd-2e43-4f7e-898e-072278696bb6 tempest-VolumesListAdminTestJSON-2011971914 None] Lock "cinder-1b5f596d-fd04-4a10-9bbe-bedcc8984e5d-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Flow 'volume_create_manager' (c9f3f705-3825-4de0-b540-4ffd03c14007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b470b8-7f5d-4690-ac70-9a447de1686c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b470b8-7f5d-4690-ac70-9a447de1686c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-789146392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec3a768-6b2e-4f65-ad03-bb381ac0bf96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c06199ba8046789a0b8eb9ac7e2dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:48Z,use_quota=True,user_id='f536e58a4228496fa2c89918822e0bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a459fbcf-6874-408f-8266-1ca9c30dc1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a459fbcf-6874-408f-8266-1ca9c30dc1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055f9812-b335-43a2-8e7c-4162a9382e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055f9812-b335-43a2-8e7c-4162a9382e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ec3a768-6b2e-4f65-ad03-bb381ac0bf96', 'volume_name': 'volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd51510-8827-4f1f-bf9d-dc4f5491895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd51510-8827-4f1f-bf9d-dc4f5491895f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebb0bf4-cee5-4edc-b26a-75a5121adba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:47 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Volume 3ec3a768-6b2e-4f65-ad03-bb381ac0bf96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96', 'volume_size': 1} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-789146392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec3a768-6b2e-4f65-ad03-bb381ac0bf96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c06199ba8046789a0b8eb9ac7e2dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:48Z,use_quota=True,user_id='f536e58a4228496fa2c89918822e0bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Creating volume 3ec3a768-6b2e-4f65-ad03-bb381ac0bf96 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:21:47 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:21:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:47 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96 1073741824 Jun 11 05:21:47 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:48 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96 1073741824" returned: 0 in 0.965s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:48 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96 Jun 11 05:21:48 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0421ffbf-b934-41fb-a6aa-8b6b6f5b5464 tempest-GroupSnapshotsV319Test-1447848394 None] Group tempest-GroupSnapshotsV319Test-Group-1455920667: creating Jun 11 05:21:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0421ffbf-b934-41fb-a6aa-8b6b6f5b5464 tempest-GroupSnapshotsV319Test-1447848394 None] Group tempest-GroupSnapshotsV319Test-Group-1455920667: created successfully Jun 11 05:21:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0421ffbf-b934-41fb-a6aa-8b6b6f5b5464 tempest-GroupSnapshotsV319Test-1447848394 None] Create group completed successfully. Jun 11 05:21:49 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96" returned: 0 in 0.780s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:49 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:21:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebb0bf4-cee5-4edc-b26a-75a5121adba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a9dc9f-389e-4678-8273-f4e199e2d7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:49 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Volume volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96 (3ec3a768-6b2e-4f65-ad03-bb381ac0bf96): created successfully Jun 11 05:21:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a9dc9f-389e-4678-8273-f4e199e2d7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Flow 'volume_create_manager' (c9f3f705-3825-4de0-b540-4ffd03c14007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3a98662f-baf2-4a3b-b781-0620425712e1 tempest-VolumesMetadataTest-228353151 None] Created volume successfully. Jun 11 05:21:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-d7d76dc6-e744-475d-ae34-1796858b7ca9 req-aa44b117-5dbb-4c32-9921-ef1048240788 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-d7d76dc6-e744-475d-ae34-1796858b7ca9 req-aa44b117-5dbb-4c32-9921-ef1048240788 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:50 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[df80e99b-518a-4560-a97d-9ce6a11bd2ea]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-d7d76dc6-e744-475d-ae34-1796858b7ca9 req-aa44b117-5dbb-4c32-9921-ef1048240788 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:50 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0 Jun 11 05:21:50 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:50 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-d7d76dc6-e744-475d-ae34-1796858b7ca9 req-aa44b117-5dbb-4c32-9921-ef1048240788 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0" returned: 0 in 0.793s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-d7d76dc6-e744-475d-ae34-1796858b7ca9 req-aa44b117-5dbb-4c32-9921-ef1048240788 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.819s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:50 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-d7d76dc6-e744-475d-ae34-1796858b7ca9 req-aa44b117-5dbb-4c32-9921-ef1048240788 tempest-TestInstancesWithCinderVolumes-930911330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad7a1b54-ac11-4c8f-a2df-8204182a0c2f', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:21:51 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-d7d76dc6-e744-475d-ae34-1796858b7ca9 req-aa44b117-5dbb-4c32-9921-ef1048240788 tempest-TestInstancesWithCinderVolumes-930911330 None] attachment_update completed successfully. Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Flow 'volume_create_manager' (57d13275-cccc-463f-9c77-d64a21f01529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c30bb6-eabb-42c1-85fd-8509e3d5ad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c30bb6-eabb-42c1-85fd-8509e3d5ad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-610385729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b35983b7-5ef1-4bcd-b1cc-0e2e1430d0fd,host='devstack@QuobyteHD#QuobyteHD',id=2d517ff2-b11c-4ec8-be77-c0e1adedd108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='592d95e5a7cb4ff1b5bd7c5cfd96c93f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:51Z,use_quota=True,user_id='cbf624c5648d4f25a2987e0a5a461544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b794198-9c30-4c8e-b08e-5d92b2002992),volume_type_id=4b794198-9c30-4c8e-b08e-5d92b2002992)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85ad26e-6785-463f-bc87-e3d36adab68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85ad26e-6785-463f-bc87-e3d36adab68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb662ca-6004-419d-a5b3-01b3bd4e0047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb662ca-6004-419d-a5b3-01b3bd4e0047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d517ff2-b11c-4ec8-be77-c0e1adedd108', 'volume_name': 'volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8550fd11-ac78-43ce-940e-fbeb1eaaef99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8550fd11-ac78-43ce-940e-fbeb1eaaef99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016369db-801d-4afc-8372-f7f3670e74d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:51 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Volume 2d517ff2-b11c-4ec8-be77-c0e1adedd108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108', 'volume_size': 1} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b35983b7-5ef1-4bcd-b1cc-0e2e1430d0fd,created_at=2026-06-11T03:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-610385729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b35983b7-5ef1-4bcd-b1cc-0e2e1430d0fd,host='devstack@QuobyteHD#QuobyteHD',id=2d517ff2-b11c-4ec8-be77-c0e1adedd108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='592d95e5a7cb4ff1b5bd7c5cfd96c93f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:51Z,use_quota=True,user_id='cbf624c5648d4f25a2987e0a5a461544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b794198-9c30-4c8e-b08e-5d92b2002992),volume_type_id=4b794198-9c30-4c8e-b08e-5d92b2002992)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Creating volume 2d517ff2-b11c-4ec8-be77-c0e1adedd108 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:21:51 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Acquiring lock "cinder-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:51 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 1073741824 Jun 11 05:21:51 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Lock "cinder-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Acquiring lock "cinder-quobyte-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Lock "cinder-quobyte-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96" acquired by "delete_volume" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99a5351-c03d-46c8-9d47-b6103cb8fa39]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:51 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96 Jun 11 05:21:51 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:52 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:52 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 1073741824" returned: 0 in 0.963s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96" returned: 0 in 0.811s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:52 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96 Jun 11 05:21:52 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:52 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 Jun 11 05:21:52 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:52 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96" returned: 0 in 0.609s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Lock "cinder-quobyte-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96" released by "delete_volume" :: held 1.469s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:52 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108" returned: 0 in 0.611s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016369db-801d-4afc-8372-f7f3670e74d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed94b0b-6a08-4ff8-8500-9fd6147e4839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:52 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Volume volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 (2d517ff2-b11c-4ec8-be77-c0e1adedd108): created successfully Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed94b0b-6a08-4ff8-8500-9fd6147e4839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Flow 'volume_create_manager' (57d13275-cccc-463f-9c77-d64a21f01529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:52 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-dc47996f-aeab-42fe-acff-6320e1c6ee80 tempest-GroupSnapshotsV319Test-1447848394 None] Created volume successfully. Jun 11 05:21:52 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Created reservations ['26472385-56f0-49f1-b091-176016614c0c', '458de9c5-69b0-4fc0-bbc5-cf06f0f7ef73', '8f2b59c3-48a7-4abd-a4ff-72cbda5c10aa', 'a2d67968-1d4e-4f0c-8c4b-7cb872a83c46'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:53 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:21:53 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Flow 'volume_create_manager' (396feb3b-0d95-4e15-a0d0-e2c1978e4767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b92e5cf1-99d7-4c2e-8631-c5919d4b9557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b92e5cf1-99d7-4c2e-8631-c5919d4b9557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-613424298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087c6fe2-e205-4fea-9e07-dbb9db3da438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acb5471501a4a4299494bdad64a7847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=59e417ba-413e-4b7e-82cb-8a2c678a1d24,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:21:53Z,use_quota=True,user_id='a295079851df43149334038d59d20570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301f7367-4a12-4fe9-a7b8-05270fdfa392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301f7367-4a12-4fe9-a7b8-05270fdfa392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71146cc8-f81c-49be-a131-172c38af5b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71146cc8-f81c-49be-a131-172c38af5b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '087c6fe2-e205-4fea-9e07-dbb9db3da438', 'volume_name': 'volume-087c6fe2-e205-4fea-9e07-dbb9db3da438', 'volume_size': 1, 'snapshot_id': '59e417ba-413e-4b7e-82cb-8a2c678a1d24'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabd2cca-52ad-4e91-8ad4-9c6fa540cdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabd2cca-52ad-4e91-8ad4-9c6fa540cdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcc409b-2d23-4895-8bf8-1cb4eb9ff5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:21:53 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Volume 087c6fe2-e205-4fea-9e07-dbb9db3da438: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-087c6fe2-e205-4fea-9e07-dbb9db3da438', 'volume_size': 1, 'snapshot_id': '59e417ba-413e-4b7e-82cb-8a2c678a1d24'} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Acquiring lock "cinder-quobyte-59e417ba-413e-4b7e-82cb-8a2c678a1d24-087c6fe2-e205-4fea-9e07-dbb9db3da438" by "_create_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Lock "cinder-quobyte-59e417ba-413e-4b7e-82cb-8a2c678a1d24-087c6fe2-e205-4fea-9e07-dbb9db3da438" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Creating volume 087c6fe2-e205-4fea-9e07-dbb9db3da438 from snapshot 59e417ba-413e-4b7e-82cb-8a2c678a1d24 {{(pid=92308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Acquiring lock "cinder-quobyte-087c6fe2-e205-4fea-9e07-dbb9db3da438" by "_copy_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Lock "cinder-quobyte-087c6fe2-e205-4fea-9e07-dbb9db3da438" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] snapshot: 59e417ba-413e-4b7e-82cb-8a2c678a1d24, volume: 087c6fe2-e205-4fea-9e07-dbb9db3da438, {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 11 05:21:53 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] GroupSnapshot dd214ab2-9204-4bfe-810e-5588e1a0e62c: creating. Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:21:53 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.772s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:21:53 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Deleted volume successfully. Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f186df6-746f-42ab-a483-ca357c0f0d32]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] Group snapshot dd214ab2-9204-4bfe-810e-5588e1a0e62c: creating. {{(pid=92308) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd1b6516-52da-4750-9cc3-62761440381e tempest-VolumesMetadataTest-228353151 None] Lock "cinder-3ec3a768-6b2e-4f65-ad03-bb381ac0bf96-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:21:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:21:53 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 Jun 11 05:21:53 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:54 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24" returned: 0 in 0.904s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16d09795-4ae6-4cc7-83ad-0a494f034528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:21:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] will copy from snapshot at /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 11 05:21:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Creating direct copy from snapshot {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 11 05:21:54 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbcc5da-5c59-4e4f-a9b9-58ab147b17a6]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:21:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:54 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 Jun 11 05:21:54 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:21:55 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jun 11 05:21:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528" returned: 0 in 1.012s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:21:55 devstack cinder-volume[92308]: DEBUG cinder.utils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Path /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 not found in is_blk_device check {{(pid=92308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 11 05:21:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:21:55 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 Jun 11 05:21:55 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:02 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438" returned: 0 in 7.075s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:02 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c511a0-cd8f-44c5-95d4-0b3ec97bff5b]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:22:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:03 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 Jun 11 05:22:03 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:03 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:22:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Flow 'volume_create_manager' (23f5d891-05f7-4cfc-8ffa-0069eb415c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:22:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e46ad1-3bad-4aba-8822-c182edffba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e46ad1-3bad-4aba-8822-c182edffba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1812498296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d6a4e0-5a7c-44b3-b511-9aae4ea83e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50bcb1a3d9ca4e95a1cb4467ecd3e90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:22:03Z,use_quota=True,user_id='9bbce19095fb40f7a4966104065b3d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20014c37-f42c-4175-87d0-47005f7c6179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20014c37-f42c-4175-87d0-47005f7c6179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db858053-ae43-4008-a348-67528e8d5330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db858053-ae43-4008-a348-67528e8d5330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d6a4e0-5a7c-44b3-b511-9aae4ea83e97', 'volume_name': 'volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197db80d-963c-468b-946a-409a2302e122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197db80d-963c-468b-946a-409a2302e122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a5cdd5-b2be-4ba9-a496-4807474e6eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:03 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Volume 00d6a4e0-5a7c-44b3-b511-9aae4ea83e97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97', 'volume_size': 1} Jun 11 05:22:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:03 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=82,cinder:SELECT=75,cinder:INSERT=20,cinder:DELETE=7 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:22:04 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528" returned: 0 in 1.151s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528, size 1024.00 MB, duration 7.08 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:22:04 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Converted 1024.00 MB image at 144.72 MB/s Jun 11 05:22:04 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 is being set with open permissions: ugo+rw Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:04 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 Jun 11 05:22:04 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:04 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-6c5abfb9-adbc-4e15-94dd-fe0823cc7984 req-19e232af-1d00-4cb3-9d6b-5836b6a2260b tempest-TestInstancesWithCinderVolumes-930911330 None] Terminate volume connection completed successfully. Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-6c5abfb9-adbc-4e15-94dd-fe0823cc7984 req-19e232af-1d00-4cb3-9d6b-5836b6a2260b tempest-TestInstancesWithCinderVolumes-930911330 None] Deleting attachment 4acc7332-ebac-49b0-b103-6c6104c9e02b. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:22:04 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438" returned: 0 in 0.748s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Lock "cinder-quobyte-087c6fe2-e205-4fea-9e07-dbb9db3da438" released by "_copy_volume_from_snapshot" :: held 11.057s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Lock "cinder-quobyte-59e417ba-413e-4b7e-82cb-8a2c678a1d24-087c6fe2-e205-4fea-9e07-dbb9db3da438" released by "_create_volume_from_snapshot" :: held 11.111s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.135s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.943s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] Creating offline snapshot ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d of volume 2d517ff2-b11c-4ec8-be77-c0e1adedd108 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcc409b-2d23-4895-8bf8-1cb4eb9ff5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087c6fe2-e205-4fea-9e07-dbb9db3da438', 'volume_size': 1, 'snapshot_id': '59e417ba-413e-4b7e-82cb-8a2c678a1d24'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce2f06a-bd7e-42f6-8a08-282e71d897b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1685caab-d41d-4b08-a634-31a6725b6009]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:04 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Volume volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 (087c6fe2-e205-4fea-9e07-dbb9db3da438): created successfully Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce2f06a-bd7e-42f6-8a08-282e71d897b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Flow 'volume_create_manager' (396feb3b-0d95-4e15-a0d0-e2c1978e4767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:22:04 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-89d41a0d-ec2f-412a-b11f-606c9a6bfa7a tempest-TestStampPattern-272184299 None] Created volume successfully. Jun 11 05:22:05 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 Jun 11 05:22:05 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:05 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108" returned: 0 in 0.760s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:05 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d 1G Jun 11 05:22:05 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "cinder-96bcc8e4-338e-4ef3-bccd-78046d731135-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:22:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "cinder-96bcc8e4-338e-4ef3-bccd-78046d731135-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:22:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "cinder-quobyte-96bcc8e4-338e-4ef3-bccd-78046d731135" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:22:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "cinder-quobyte-96bcc8e4-338e-4ef3-bccd-78046d731135" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:22:06 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c75670-6b14-42d0-96ff-c4eff6835e62]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:22:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:06 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135 Jun 11 05:22:06 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:06 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d 1G" returned: 0 in 0.823s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:06 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d Jun 11 05:22:06 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:06 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135" returned: 0 in 0.784s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:06 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135 Jun 11 05:22:06 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:07 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d" returned: 0 in 0.792s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:07 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:22:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:07 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d Jun 11 05:22:07 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:07 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-96bcc8e4-338e-4ef3-bccd-78046d731135" returned: 0 in 0.771s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:07 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "cinder-quobyte-96bcc8e4-338e-4ef3-bccd-78046d731135" released by "delete_volume" :: held 1.600s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:07 devstack cinder-volume[92308]: WARNING cinder.quota [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-631778695-223417925 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-631778695-223417925, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:22:07 devstack cinder-volume[92308]: WARNING cinder.quota [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-631778695-223417925 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-631778695-223417925, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:22:07 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Created reservations ['9972dd7b-c9b6-44e9-a3d3-31c21e23c39f', '1d1e0e5c-74fa-419c-ba4e-fb3e016a49e5', '304550aa-b1e7-4e47-8232-fe1bb5decf79', 'b9d28749-0ca6-47bc-ac35-1cc7fac7e9c3'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:22:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:22:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:22:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:07 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:22:07 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:07 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d" returned: 0 in 0.719s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:08 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.info Jun 11 05:22:08 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:08 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.683s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:08 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:22:08 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Deleted volume successfully. Jun 11 05:22:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-99b96f06-e787-46b5-a402-9f0f1bed119d tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "cinder-96bcc8e4-338e-4ef3-bccd-78046d731135-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:08 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.info" returned: 0 in 0.708s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:08 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.info is being set with open permissions: ugo+rw: NotImplementedError Jun 11 05:22:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:08 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.info Jun 11 05:22:08 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:09 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.info" returned: 0 in 0.608s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.542s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.844s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1812498296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d6a4e0-5a7c-44b3-b511-9aae4ea83e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50bcb1a3d9ca4e95a1cb4467ecd3e90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:22:03Z,use_quota=True,user_id='9bbce19095fb40f7a4966104065b3d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:22:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Creating volume 00d6a4e0-5a7c-44b3-b511-9aae4ea83e97 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:22:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:22:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:22:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:22:09 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:22:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:09 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97 1073741824 Jun 11 05:22:09 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:09 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9b1c66b4-de7a-4753-a214-b2ee7749b424 tempest-GroupSnapshotsV319Test-1447848394 None] group_snapshot dd214ab2-9204-4bfe-810e-5588e1a0e62c: created successfully Jun 11 05:22:10 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] group_snapshot dd214ab2-9204-4bfe-810e-5588e1a0e62c: deleting Jun 11 05:22:10 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] group_snapshot dd214ab2-9204-4bfe-810e-5588e1a0e62c: deleting {{(pid=92308) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 11 05:22:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97 1073741824" returned: 0 in 1.250s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Acquiring lock "cinder-quobyte-2d517ff2-b11c-4ec8-be77-c0e1adedd108" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:22:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "cinder-quobyte-2d517ff2-b11c-4ec8-be77-c0e1adedd108" acquired by "delete_snapshot" :: waited 0.037s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:22:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Acquiring lock "cinder-quobyte-ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:22:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "cinder-quobyte-ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:22:10 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97 Jun 11 05:22:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Deleting offline snapshot ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d of volume 2d517ff2-b11c-4ec8-be77-c0e1adedd108 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:22:10 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] snapshot_file for this snap is: volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:22:10 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b52b18-8570-45d4-95c2-9206dcafc02d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:22:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:10 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d Jun 11 05:22:10 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:11 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-4d8e4a5f-d50a-4c2c-b81b-6de46d927606 req-ffdffd0c-0616-46be-ae7b-8d290956fe90 tempest-TestInstancesWithCinderVolumes-930911330 None] Terminate volume connection completed successfully. Jun 11 05:22:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-4d8e4a5f-d50a-4c2c-b81b-6de46d927606 req-ffdffd0c-0616-46be-ae7b-8d290956fe90 tempest-TestInstancesWithCinderVolumes-930911330 None] Deleting attachment ad7a1b54-ac11-4c8f-a2df-8204182a0c2f. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:22:11 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97" returned: 0 in 0.833s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:22:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.179s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a5cdd5-b2be-4ba9-a496-4807474e6eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ba2908-dc6b-415c-b40d-d480659ce605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:11 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Volume volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97 (00d6a4e0-5a7c-44b3-b511-9aae4ea83e97): created successfully Jun 11 05:22:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ba2908-dc6b-415c-b40d-d480659ce605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Flow 'volume_create_manager' (23f5d891-05f7-4cfc-8ffa-0069eb415c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:22:11 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3a7e5292-7a4f-4b57-bdd4-1213edb96ffd tempest-VolumesTransfersTest-1467943328 None] Created volume successfully. Jun 11 05:22:11 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d" returned: 0 in 0.969s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:22:11 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a04ba0-b854-46bd-866b-ae6eba6c4974]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:22:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:11 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 Jun 11 05:22:11 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:12 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108" returned: 0 in 1.023s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:12 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d Jun 11 05:22:12 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:13 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a6ae40e2-bab5-495d-b091-bb7e8183d13e tempest-VolumesTransfersTest-877837150 None] Transfer volume completed successfully. Jun 11 05:22:13 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "cinder-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:22:13 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "cinder-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:22:13 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "cinder-quobyte-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:22:13 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "cinder-quobyte-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0" acquired by "delete_volume" :: waited 0.026s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:22:13 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc941ce-6c82-4008-b1c4-27d4217b4903]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:22:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:13 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0 Jun 11 05:22:13 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Acquiring lock "cinder-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:22:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Lock "cinder-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:22:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Acquiring lock "cinder-quobyte-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:22:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Lock "cinder-quobyte-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97" acquired by "delete_volume" :: waited 0.035s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:22:14 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d" returned: 0 in 1.707s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:14 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4adff47-b59f-46ec-8fea-9c6e4f404239]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:22:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:14 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d Jun 11 05:22:14 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:14 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97 Jun 11 05:22:14 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:14 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0" returned: 0 in 1.700s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:15 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0 Jun 11 05:22:15 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:15 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108.ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d" returned: 0 in 1.066s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "cinder-quobyte-ceec88d2-e9e8-4dfa-ba5c-f72021d0fc1d" released by "_delete_snapshot" :: held 4.984s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "cinder-quobyte-2d517ff2-b11c-4ec8-be77-c0e1adedd108" released by "delete_snapshot" :: held 5.042s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:15 devstack cinder-volume[92308]: WARNING cinder.quota [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-413739021 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-413739021, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:22:15 devstack cinder-volume[92308]: WARNING cinder.quota [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-413739021 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-413739021, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:22:15 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] Created reservations ['b0235346-255e-4ecd-96db-7ff485aeaa0f', '0f469903-c53f-49c1-afe3-03f480078017', '2be47660-25c9-49b1-99e5-83b8c67c0108', '41fa062a-e132-4152-a58c-ffc313c05c08'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:22:15 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f488fc77-13a7-4666-8aaa-6bd230201cb2 tempest-GroupSnapshotsV319Test-1447848394 None] group_snapshot dd214ab2-9204-4bfe-810e-5588e1a0e62c: deleted successfully Jun 11 05:22:16 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0" returned: 0 in 1.289s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "cinder-quobyte-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0" released by "delete_volume" :: held 3.095s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:16 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97" returned: 0 in 1.726s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:16 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97 Jun 11 05:22:16 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:16 devstack cinder-volume[92308]: WARNING cinder.quota [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1207551744-1681683303 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1207551744-1681683303, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:22:16 devstack cinder-volume[92308]: WARNING cinder.quota [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1207551744-1681683303 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1207551744-1681683303, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Created reservations ['71a4a74c-54d3-4012-ab16-12445758687f', 'b2005060-8666-4149-aa75-c2f11e0186b7', '1de3af28-d873-4b36-b140-24ff607134d6', 'bbafbbfc-b071-47cf-b8ae-a80de34f740a'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Acquiring lock "cinder-quobyte-2d517ff2-b11c-4ec8-be77-c0e1adedd108" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "cinder-quobyte-2d517ff2-b11c-4ec8-be77-c0e1adedd108" acquired by "delete_volume" :: waited 0.067s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bd0aad-ef40-4ff9-a3b1-c99fc4987787]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:16 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:22:16 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:17 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 Jun 11 05:22:17 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:17 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97" returned: 0 in 1.380s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Lock "cinder-quobyte-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97" released by "delete_volume" :: held 3.223s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:17 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Created reservations ['5f639af0-d068-41dc-b4b0-422492955fd9', '82826493-5067-4fb6-ad16-d4cba0eeacaa', 'd159b1a2-6dc2-4709-abc3-ffbf12625160', '19d0868d-0a3c-4d5d-9026-98118ce28148'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:22:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:22:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:22:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:18 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:22:18 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:18 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.334s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:18 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:22:18 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Deleted volume successfully. Jun 11 05:22:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4868144-f0e1-46f4-94f4-342f01cfb456 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "cinder-82ccd1c9-c2c7-41b6-8a97-a0a0be919fe0-delete_volume" released by "delete_volume" :: held 5.188s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:19 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108" returned: 0 in 2.417s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:19 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108 Jun 11 05:22:19 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Flow 'volume_create_manager' (46af14f4-7428-4f6d-91bd-e799ee86d2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f863d986-973e-4f24-a524-9875e7b00a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f863d986-973e-4f24-a524-9875e7b00a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1778809958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e27734-c391-4b31-be27-19cb4a3abfe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50bcb1a3d9ca4e95a1cb4467ecd3e90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:22:19Z,use_quota=True,user_id='9bbce19095fb40f7a4966104065b3d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1aa98d-15d4-4a92-96f9-b068ad331f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1aa98d-15d4-4a92-96f9-b068ad331f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85f3f31-88ba-491b-8a17-f1dd6e78b38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85f3f31-88ba-491b-8a17-f1dd6e78b38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e27734-c391-4b31-be27-19cb4a3abfe6', 'volume_name': 'volume-80e27734-c391-4b31-be27-19cb4a3abfe6', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3984ef-87ab-47b3-9c89-70158b771f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3984ef-87ab-47b3-9c89-70158b771f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4d36c9-2bd7-4762-9edd-638bcf96fac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:19 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Volume 80e27734-c391-4b31-be27-19cb4a3abfe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e27734-c391-4b31-be27-19cb4a3abfe6', 'volume_size': 1} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1778809958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e27734-c391-4b31-be27-19cb4a3abfe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50bcb1a3d9ca4e95a1cb4467ecd3e90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:22:19Z,use_quota=True,user_id='9bbce19095fb40f7a4966104065b3d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Creating volume 80e27734-c391-4b31-be27-19cb4a3abfe6 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:22:19 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80e27734-c391-4b31-be27-19cb4a3abfe6 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:19 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80e27734-c391-4b31-be27-19cb4a3abfe6 1073741824 Jun 11 05:22:19 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:19 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.963s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:19 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:22:20 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Deleted volume successfully. Jun 11 05:22:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fac26a6a-ad6a-40ab-adbc-ee27aa16d20d tempest-VolumesTransfersTest-468996707 None] Lock "cinder-00d6a4e0-5a7c-44b3-b511-9aae4ea83e97-delete_volume" released by "delete_volume" :: held 5.696s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:20 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2d517ff2-b11c-4ec8-be77-c0e1adedd108" returned: 0 in 1.313s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "cinder-quobyte-2d517ff2-b11c-4ec8-be77-c0e1adedd108" released by "delete_volume" :: held 3.869s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:20 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Created reservations ['fa009a33-d003-4ba5-8cc8-6544c3846a3a'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:22:20 devstack cinder-volume[92308]: WARNING cinder.quota [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-413739021 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-413739021, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:22:20 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Created reservations ['4031f112-4b8f-4c61-bbf4-537b28676e5e', '5d434721-1d34-43bc-8cba-76e21a97c048', '3fcb4210-f5a9-4e43-8d42-dc58fd170a1a', '7238c4b9-52d8-46a4-a52b-ba2b06044b58'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:22:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:20 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:22:20 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:22:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:21 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:22:21 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:21 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80e27734-c391-4b31-be27-19cb4a3abfe6 1073741824" returned: 0 in 2.034s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80e27734-c391-4b31-be27-19cb4a3abfe6 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:21 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80e27734-c391-4b31-be27-19cb4a3abfe6 Jun 11 05:22:21 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:21 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.984s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:21 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:22:21 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-370a35cb-fb68-4cb1-ad0e-5b8b82cdad18 tempest-GroupSnapshotsV319Test-1447848394 None] Delete group completed successfully. Jun 11 05:22:22 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80e27734-c391-4b31-be27-19cb4a3abfe6" returned: 0 in 0.987s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] <== create_volume: return (3084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:22:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.088s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4d36c9-2bd7-4762-9edd-638bcf96fac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e27734-c391-4b31-be27-19cb4a3abfe6', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fbc2d9-fcf9-416b-87af-b00a2be79358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:22 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Volume volume-80e27734-c391-4b31-be27-19cb4a3abfe6 (80e27734-c391-4b31-be27-19cb4a3abfe6): created successfully Jun 11 05:22:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fbc2d9-fcf9-416b-87af-b00a2be79358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Flow 'volume_create_manager' (46af14f4-7428-4f6d-91bd-e799ee86d2b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:22:22 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-4eceb517-feef-420e-bbc5-277ca330deb0 tempest-VolumesTransfersTest-1467943328 None] Created volume successfully. Jun 11 05:22:23 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-8d892d53-b790-49ef-8469-562ceea07683 req-99ec602d-a38a-41b6-b8f0-ed2e21dbeb79 tempest-TestInstancesWithCinderVolumes-930911330 None] Terminate volume connection completed successfully. Jun 11 05:22:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-8d892d53-b790-49ef-8469-562ceea07683 req-99ec602d-a38a-41b6-b8f0-ed2e21dbeb79 tempest-TestInstancesWithCinderVolumes-930911330 None] Deleting attachment fcd00d22-93c9-43d2-9cd8-38ecec0e59c6. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:22:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Acquiring lock "cinder-80e27734-c391-4b31-be27-19cb4a3abfe6-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:22:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Lock "cinder-80e27734-c391-4b31-be27-19cb4a3abfe6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:22:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Acquiring lock "cinder-quobyte-80e27734-c391-4b31-be27-19cb4a3abfe6" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:22:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Lock "cinder-quobyte-80e27734-c391-4b31-be27-19cb4a3abfe6" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:22:24 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5456c344-8321-4d8a-bbb8-74c8b8a651af]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:22:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80e27734-c391-4b31-be27-19cb4a3abfe6 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:24 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80e27734-c391-4b31-be27-19cb4a3abfe6 Jun 11 05:22:24 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:25 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80e27734-c391-4b31-be27-19cb4a3abfe6" returned: 0 in 0.824s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80e27734-c391-4b31-be27-19cb4a3abfe6 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:25 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80e27734-c391-4b31-be27-19cb4a3abfe6 Jun 11 05:22:25 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:25 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-80e27734-c391-4b31-be27-19cb4a3abfe6" returned: 0 in 0.653s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:25 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Lock "cinder-quobyte-80e27734-c391-4b31-be27-19cb4a3abfe6" released by "delete_volume" :: held 1.534s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:25 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Created reservations ['641a0df6-c122-4972-97f1-2eaf4dfa1b2c', '4bc7467b-da2e-4cdb-aef9-94786886c449', '86a2fee8-628b-44cd-ada1-6fcce4e99b2a', 'd460bf67-74de-4914-ab13-728311fd72bd'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:22:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:22:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:22:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:25 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:22:25 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:26 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.667s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:26 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:22:26 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Deleted volume successfully. Jun 11 05:22:26 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=114,cinder:INSERT=32,cinder:UPDATE=151,cinder:DELETE=9 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:22:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d7c87e2f-6fc2-4005-9000-1a21d5d0b4f5 tempest-VolumesTransfersTest-468996707 None] Lock "cinder-80e27734-c391-4b31-be27-19cb4a3abfe6-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "cinder-8783d4cf-70c0-4cd9-9b53-e20973af042c-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:22:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "cinder-8783d4cf-70c0-4cd9-9b53-e20973af042c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:22:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "cinder-quobyte-8783d4cf-70c0-4cd9-9b53-e20973af042c" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:22:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "cinder-quobyte-8783d4cf-70c0-4cd9-9b53-e20973af042c" acquired by "delete_volume" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:22:27 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a938a0a7-d298-4062-94fc-59b385c8687d]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:22:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:27 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c Jun 11 05:22:27 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:28 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c" returned: 0 in 0.801s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:28 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c Jun 11 05:22:28 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:29 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c" returned: 1 in 0.745s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:22:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:29 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c Jun 11 05:22:29 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:29 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8783d4cf-70c0-4cd9-9b53-e20973af042c" returned: 0 in 0.647s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "cinder-quobyte-8783d4cf-70c0-4cd9-9b53-e20973af042c" released by "delete_volume" :: held 2.270s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:29 devstack cinder-volume[92308]: WARNING cinder.quota [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1188086880-1185568580 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1188086880-1185568580, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:22:29 devstack cinder-volume[92308]: WARNING cinder.quota [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1188086880-1185568580 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1188086880-1185568580, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:22:29 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Created reservations ['5bb9fcf5-58d0-4f3a-8d6e-90ff38896499', 'acd14cbf-33b4-49ba-9134-4d9e13aa5251', '105f32d5-550a-4877-914c-0f08b1e7e6f6', 'ff847506-a295-486c-8478-a67127184d7a'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:22:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:22:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:22:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:29 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:22:29 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:22:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:22:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:22:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:30 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:22:30 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:30 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.723s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:30 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:22:30 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Deleted volume successfully. Jun 11 05:22:30 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9a1385d7-e960-4127-b77e-08d3af82fe11 tempest-TestInstancesWithCinderVolumes-930911330 None] Lock "cinder-8783d4cf-70c0-4cd9-9b53-e20973af042c-delete_volume" released by "delete_volume" :: held 3.279s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:22:31 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.789s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:22:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:22:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:22:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:22:40 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=51,cinder:UPDATE=66,cinder:DELETE=7,cinder:INSERT=18 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Flow 'volume_create_manager' (a8c35415-c521-4a53-9d37-28d04c8b6a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be6a3b4-bbb1-4146-a2f6-15774a5f3191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be6a3b4-bbb1-4146-a2f6-15774a5f3191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1103517119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fef9c36-c6f8-42a5-80ea-8bce4f4b3332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1279e0ee18dd47b890ad329c1e207116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:22:42Z,use_quota=True,user_id='e0efe5db8e9c4b43bc71395ba9fec188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d6835d-a9c8-4101-a8b3-4ea4a26c4ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d6835d-a9c8-4101-a8b3-4ea4a26c4ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d8f749-4371-4fe2-8502-a76940b978c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d8f749-4371-4fe2-8502-a76940b978c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fef9c36-c6f8-42a5-80ea-8bce4f4b3332', 'volume_name': 'volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dff5991-2cfb-4302-b09e-1ff204c555c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dff5991-2cfb-4302-b09e-1ff204c555c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eead848d-dacf-42ac-9bde-0285dc99d48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:41 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Volume 8fef9c36-c6f8-42a5-80ea-8bce4f4b3332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332', 'volume_size': 1} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1103517119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fef9c36-c6f8-42a5-80ea-8bce4f4b3332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1279e0ee18dd47b890ad329c1e207116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:22:42Z,use_quota=True,user_id='e0efe5db8e9c4b43bc71395ba9fec188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Creating volume 8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:22:41 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:22:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:41 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 1073741824 Jun 11 05:22:41 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:42 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 1073741824" returned: 0 in 1.074s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:42 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 Jun 11 05:22:42 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:43 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" returned: 0 in 0.889s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:22:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eead848d-dacf-42ac-9bde-0285dc99d48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc94bc3a-0983-4617-b170-eba22a642ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:22:43 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Volume volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 (8fef9c36-c6f8-42a5-80ea-8bce4f4b3332): created successfully Jun 11 05:22:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc94bc3a-0983-4617-b170-eba22a642ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:22:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Flow 'volume_create_manager' (a8c35415-c521-4a53-9d37-28d04c8b6a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:22:43 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-d9fb5f08-d982-4e39-82b5-b2043ae4abbf tempest-VolumesActionsTest-2067611301 None] Created volume successfully. Jun 11 05:22:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-30c21dba-3c7d-4594-a3ab-59f3af96a54a req-2b378052-20db-4c7d-8710-e78e7ed664cd tempest-TestStampPattern-272184299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:22:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-30c21dba-3c7d-4594-a3ab-59f3af96a54a req-2b378052-20db-4c7d-8710-e78e7ed664cd tempest-TestStampPattern-272184299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:22:47 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[871060ee-5de3-46f0-b8bd-db20d70ea03b]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:22:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-30c21dba-3c7d-4594-a3ab-59f3af96a54a req-2b378052-20db-4c7d-8710-e78e7ed664cd tempest-TestStampPattern-272184299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:22:47 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 Jun 11 05:22:47 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:22:48 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jun 11 05:22:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-30c21dba-3c7d-4594-a3ab-59f3af96a54a req-2b378052-20db-4c7d-8710-e78e7ed664cd tempest-TestStampPattern-272184299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438" returned: 0 in 0.897s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:22:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-30c21dba-3c7d-4594-a3ab-59f3af96a54a req-2b378052-20db-4c7d-8710-e78e7ed664cd tempest-TestStampPattern-272184299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.925s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:22:48 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-30c21dba-3c7d-4594-a3ab-59f3af96a54a req-2b378052-20db-4c7d-8710-e78e7ed664cd tempest-TestStampPattern-272184299 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-087c6fe2-e205-4fea-9e07-dbb9db3da438', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7794496-b30d-4820-bd4c-2dda3a59c38c', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:22:48 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-30c21dba-3c7d-4594-a3ab-59f3af96a54a req-2b378052-20db-4c7d-8710-e78e7ed664cd tempest-TestStampPattern-272184299 None] attachment_update completed successfully. Jun 11 05:22:56 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-0f285fd2-f421-4b85-8d80-bb76a5624a5c req-604bc733-7634-4282-b79e-243ce6229ca7 tempest-TestStampPattern-272184299 None] Terminate volume connection completed successfully. Jun 11 05:22:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-0f285fd2-f421-4b85-8d80-bb76a5624a5c req-604bc733-7634-4282-b79e-243ce6229ca7 tempest-TestStampPattern-272184299 None] Deleting attachment f7794496-b30d-4820-bd4c-2dda3a59c38c. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:22:58 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=15,cinder:INSERT=1,cinder:UPDATE=14 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:23:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0c67af5a-2143-47ce-8a46-c0d5cce3423b tempest-VolumesActionsTest-2067611301 None] Acquiring lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" by "attach_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0c67af5a-2143-47ce-8a46-c0d5cce3423b tempest-VolumesActionsTest-2067611301 None] Lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" acquired by "attach_volume" :: waited 0.033s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:05 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0c67af5a-2143-47ce-8a46-c0d5cce3423b tempest-VolumesActionsTest-2067611301 None] Attaching volume 8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 to instance 27343c87-18ae-4b99-8e38-b6749c99d4ab at mountpoint /dev/vdb on host None. Jun 11 05:23:05 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0c67af5a-2143-47ce-8a46-c0d5cce3423b tempest-VolumesActionsTest-2067611301 None] Attach volume completed successfully. Jun 11 05:23:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0c67af5a-2143-47ce-8a46-c0d5cce3423b tempest-VolumesActionsTest-2067611301 None] Lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" released by "attach_volume" :: held 0.200s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1abb2004-275a-4bc9-a676-a8a4f6e505cb tempest-VolumesActionsTest-2067611301 None] Acquiring lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332-detach_volume" by "detach_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1abb2004-275a-4bc9-a676-a8a4f6e505cb tempest-VolumesActionsTest-2067611301 None] Lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:06 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-1abb2004-275a-4bc9-a676-a8a4f6e505cb tempest-VolumesActionsTest-2067611301 None] Detaching volume 8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 from instance 27343c87-18ae-4b99-8e38-b6749c99d4ab. Jun 11 05:23:06 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-1abb2004-275a-4bc9-a676-a8a4f6e505cb tempest-VolumesActionsTest-2067611301 None] Detach volume completed successfully. Jun 11 05:23:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1abb2004-275a-4bc9-a676-a8a4f6e505cb tempest-VolumesActionsTest-2067611301 None] Lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:06 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:23:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Flow 'volume_create_manager' (bcee28e1-7f76-4d19-8a60-6e29f6cb8a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:23:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68eef479-02af-434e-bd1a-fc80631569dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68eef479-02af-434e-bd1a-fc80631569dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1819887668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4407067b-d448-4ab7-9256-fae0f01dfe91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f504a8b7ef6a4b8c9b84499aa578b7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:23:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:23:07Z,use_quota=True,user_id='8b76ca61062b42c1bd7f55d1a0ffa747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00434e7f-17fa-4f07-8454-68bac58a7292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00434e7f-17fa-4f07-8454-68bac58a7292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4270b6-806d-4060-9070-9b70c3f3ffb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4270b6-806d-4060-9070-9b70c3f3ffb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4407067b-d448-4ab7-9256-fae0f01dfe91', 'volume_name': 'volume-4407067b-d448-4ab7-9256-fae0f01dfe91', 'volume_size': 2}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3001e8-3f02-466e-a49f-6e16a9d0ebae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3001e8-3f02-466e-a49f-6e16a9d0ebae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e24d8c-82e3-46da-8573-04396d21470c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:07 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Volume 4407067b-d448-4ab7-9256-fae0f01dfe91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4407067b-d448-4ab7-9256-fae0f01dfe91', 'volume_size': 2} Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1819887668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4407067b-d448-4ab7-9256-fae0f01dfe91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f504a8b7ef6a4b8c9b84499aa578b7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:23:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:23:07Z,use_quota=True,user_id='8b76ca61062b42c1bd7f55d1a0ffa747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Creating volume 4407067b-d448-4ab7-9256-fae0f01dfe91 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:23:07 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:23:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91 2147483648 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:07 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91 2147483648 Jun 11 05:23:07 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:08 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91 2147483648" returned: 0 in 1.336s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:08 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91 Jun 11 05:23:08 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Acquiring lock "cinder-087c6fe2-e205-4fea-9e07-dbb9db3da438-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Lock "cinder-087c6fe2-e205-4fea-9e07-dbb9db3da438-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Acquiring lock "cinder-quobyte-087c6fe2-e205-4fea-9e07-dbb9db3da438" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Lock "cinder-quobyte-087c6fe2-e205-4fea-9e07-dbb9db3da438" acquired by "delete_volume" :: waited 0.049s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:09 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:09 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fd9a6d-74ed-4fed-9cfb-dc8a53a6cb9f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91" returned: 0 in 0.960s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] <== create_volume: return (2379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:23:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.382s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:23:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e24d8c-82e3-46da-8573-04396d21470c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4407067b-d448-4ab7-9256-fae0f01dfe91', 'volume_size': 2}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7809f0d6-991d-405f-8b8e-a3dcb78d29a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:09 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Volume volume-4407067b-d448-4ab7-9256-fae0f01dfe91 (4407067b-d448-4ab7-9256-fae0f01dfe91): created successfully Jun 11 05:23:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7809f0d6-991d-405f-8b8e-a3dcb78d29a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Flow 'volume_create_manager' (bcee28e1-7f76-4d19-8a60-6e29f6cb8a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:23:09 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-1d5d69de-6fae-49f4-b3ab-d57cfc3ec066 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Created volume successfully. Jun 11 05:23:09 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 Jun 11 05:23:09 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:10 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438" returned: 0 in 0.776s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:10 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438 Jun 11 05:23:10 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:23:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:23:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Creating offline snapshot 95749b69-37b7-49c9-9739-396efdc87a15 of volume 4407067b-d448-4ab7-9256-fae0f01dfe91 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:23:10 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ae249a-2662-46c5-b14b-205c9542c15f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:10 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91 Jun 11 05:23:10 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:10 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-087c6fe2-e205-4fea-9e07-dbb9db3da438" returned: 0 in 0.782s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Lock "cinder-quobyte-087c6fe2-e205-4fea-9e07-dbb9db3da438" released by "delete_volume" :: held 1.659s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:11 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Created reservations ['40254501-37d0-4b4a-a98a-890840659fb7', 'daa8bbc0-26d6-40bd-8223-d994fe201439', '7a744e0a-d3d9-49b3-9560-ede5466082d1', 'be326222-82b2-4876-98da-2596fdff84a6'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:23:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:23:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:23:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:23:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:23:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:23:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:11 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:23:11 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:11 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91" returned: 0 in 0.763s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 2G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:11 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 2G Jun 11 05:23:11 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:12 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.040s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:23:12 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Deleted volume successfully. Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Acquiring lock "cinder-59e417ba-413e-4b7e-82cb-8a2c678a1d24-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Lock "cinder-59e417ba-413e-4b7e-82cb-8a2c678a1d24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Acquiring lock "cinder-quobyte-16d09795-4ae6-4cc7-83ad-0a494f034528" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5c8abc8e-8114-43cf-aa6b-dcc570a78b44 tempest-TestStampPattern-272184299 None] Lock "cinder-087c6fe2-e205-4fea-9e07-dbb9db3da438-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Lock "cinder-quobyte-16d09795-4ae6-4cc7-83ad-0a494f034528" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Acquiring lock "cinder-quobyte-59e417ba-413e-4b7e-82cb-8a2c678a1d24" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Lock "cinder-quobyte-59e417ba-413e-4b7e-82cb-8a2c678a1d24" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Deleting offline snapshot 59e417ba-413e-4b7e-82cb-8a2c678a1d24 of volume 16d09795-4ae6-4cc7-83ad-0a494f034528 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] snapshot_file for this snap is: volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c288565-b05f-4310-818d-acbca55307e6]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:12 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 Jun 11 05:23:12 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:12 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 2G" returned: 0 in 1.145s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4407067b-d448-4ab7-9256-fae0f01dfe91 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:12 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4407067b-d448-4ab7-9256-fae0f01dfe91 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 Jun 11 05:23:12 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:13 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24" returned: 0 in 0.964s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16d09795-4ae6-4cc7-83ad-0a494f034528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:23:13 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[079718e2-0265-4ea0-a93e-0cb403da04e0]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:13 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4407067b-d448-4ab7-9256-fae0f01dfe91 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15" returned: 0 in 0.876s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:13 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 is being set with open permissions: ugo+rw Jun 11 05:23:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:13 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 Jun 11 05:23:13 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:13 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 Jun 11 05:23:13 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:14 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15" returned: 0 in 0.868s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:14 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.info Jun 11 05:23:14 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:14 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528" returned: 0 in 1.126s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:14 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 Jun 11 05:23:14 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:15 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.info" returned: 0 in 0.874s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:15 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.info is being set with open permissions: ugo+rw Jun 11 05:23:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:15 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.info Jun 11 05:23:15 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:15 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24" returned: 0 in 0.968s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:15 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24 Jun 11 05:23:15 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:16 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.info" returned: 0 in 0.916s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.609s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:23:16 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528.59e417ba-413e-4b7e-82cb-8a2c678a1d24" returned: 0 in 0.812s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:16 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3d690970-8641-495b-ac72-1ec0502266cc tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Create snapshot completed successfully Jun 11 05:23:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Lock "cinder-quobyte-59e417ba-413e-4b7e-82cb-8a2c678a1d24" released by "_delete_snapshot" :: held 4.020s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Lock "cinder-quobyte-16d09795-4ae6-4cc7-83ad-0a494f034528" released by "delete_snapshot" :: held 4.053s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:16 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Created reservations ['9261c157-b756-41f6-9f91-903bcd438b7c', '62460715-251c-4409-ac23-f90e2af9f124', '4f2fc6a4-37f4-4a72-ad7f-2f1b245022da', 'a7c2a37d-1650-4c09-9cc6-7f4d9adc92c4'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:23:16 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Delete snapshot completed successfully. Jun 11 05:23:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e50c1652-48ab-4206-9c06-1e52497cbaa2 tempest-TestStampPattern-272184299 None] Lock "cinder-59e417ba-413e-4b7e-82cb-8a2c678a1d24-delete_snapshot" released by "delete_snapshot" :: held 4.202s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Acquiring lock "cinder-95749b69-37b7-49c9-9739-396efdc87a15-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "cinder-95749b69-37b7-49c9-9739-396efdc87a15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Acquiring lock "cinder-quobyte-4407067b-d448-4ab7-9256-fae0f01dfe91" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "cinder-quobyte-4407067b-d448-4ab7-9256-fae0f01dfe91" acquired by "delete_snapshot" :: waited 0.051s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Acquiring lock "cinder-quobyte-95749b69-37b7-49c9-9739-396efdc87a15" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "cinder-quobyte-95749b69-37b7-49c9-9739-396efdc87a15" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Deleting offline snapshot 95749b69-37b7-49c9-9739-396efdc87a15 of volume 4407067b-d448-4ab7-9256-fae0f01dfe91 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:23:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] snapshot_file for this snap is: volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:23:17 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dea265d-2262-44d3-b30f-1996cc6b4c43]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:17 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 Jun 11 05:23:17 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:18 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15" returned: 0 in 0.814s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4407067b-d448-4ab7-9256-fae0f01dfe91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:23:18 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f996a5-0956-425c-992d-e4a68bde8eb1]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:18 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91 Jun 11 05:23:18 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:19 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91" returned: 0 in 0.880s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:19 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 Jun 11 05:23:19 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:19 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15" returned: 0 in 0.881s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:19 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15 Jun 11 05:23:19 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:20 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91.95749b69-37b7-49c9-9739-396efdc87a15" returned: 0 in 0.657s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "cinder-quobyte-95749b69-37b7-49c9-9739-396efdc87a15" released by "_delete_snapshot" :: held 3.427s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "cinder-quobyte-4407067b-d448-4ab7-9256-fae0f01dfe91" released by "delete_snapshot" :: held 3.465s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:20 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Created reservations ['8ac9d82a-b036-45d4-89bd-9e6eaa6245bf', '2c6c6290-b309-4275-854d-d0dbe8a10959', '85542cf3-cb0a-4035-8098-e021c4e4a175', '3554fbc8-e327-4ec1-9f19-3c047bf7fe28'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:23:20 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Delete snapshot completed successfully. Jun 11 05:23:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d22ad4b-1880-460f-9423-a4b29317f61c tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "cinder-95749b69-37b7-49c9-9739-396efdc87a15-delete_snapshot" released by "delete_snapshot" :: held 3.725s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Acquiring lock "cinder-4407067b-d448-4ab7-9256-fae0f01dfe91-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "cinder-4407067b-d448-4ab7-9256-fae0f01dfe91-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Acquiring lock "cinder-quobyte-4407067b-d448-4ab7-9256-fae0f01dfe91" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "cinder-quobyte-4407067b-d448-4ab7-9256-fae0f01dfe91" acquired by "delete_volume" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:21 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f4b5d4-d425-45bb-a8eb-e41e8826b26a]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:21 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91 Jun 11 05:23:21 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:22 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91" returned: 0 in 1.000s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:22 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91 Jun 11 05:23:22 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:22 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:23:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Flow 'volume_create_manager' (bcfbebd8-0f6a-47e2-b5c7-fb1cf8717ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:23:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1967685a-2205-4c04-8e8b-0e344336f06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1967685a-2205-4c04-8e8b-0e344336f06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1576175652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7be8c4-69ed-44ba-bda9-637bdebc7e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0543cf357ec0460fb52ab6f3cd8aa764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:23:23Z,use_quota=True,user_id='96a976bae424486fa2c8ac4e5e640889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e2d891-2c97-4581-ac2b-fdc361323b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e2d891-2c97-4581-ac2b-fdc361323b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c067c179-5251-4fe2-b111-55297aced265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:22 devstack cinder-volume[92308]: DEBUG cinder.image.glance [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Creating Keystone auth plugin from conf {{(pid=92308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c067c179-5251-4fe2-b111-55297aced265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c7be8c4-69ed-44ba-bda9-637bdebc7e5b', 'volume_name': 'volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b', 'volume_size': 1, 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fc36ed7ee404444980e7b3d4d23270a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'created_at': datetime.datetime(2026, 6, 11, 3, 3, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 3, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5948caf3-a8c7-4db4-a99d-12690a647bd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddd10ef-7de4-4dd2-9b79-51575c02017d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ddd10ef-7de4-4dd2-9b79-51575c02017d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7896cb66-7134-4257-a388-70621f441c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:23 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Volume 4c7be8c4-69ed-44ba-bda9-637bdebc7e5b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b', 'volume_size': 1, 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fc36ed7ee404444980e7b3d4d23270a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'created_at': datetime.datetime(2026, 6, 11, 3, 3, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 3, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5948caf3-a8c7-4db4-a99d-12690a647bd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Trying to clone 4c7be8c4-69ed-44ba-bda9-637bdebc7e5b from image 5948caf3-a8c7-4db4-a99d-12690a647bd4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]). {{(pid=92308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 11 05:23:23 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4407067b-d448-4ab7-9256-fae0f01dfe91" returned: 0 in 0.717s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "cinder-quobyte-4407067b-d448-4ab7-9256-fae0f01dfe91" released by "delete_volume" :: held 1.805s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Created reservations ['83d2fbec-829c-4289-9367-e3155b2c4857', 'faeb2972-e5a7-47ca-bd82-fd364f4ba42b', 'f3ca5169-d586-4450-b73f-e959d2dab7bf', '249c410b-3d27-49ef-b020-6cc1b86f483f'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:23 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:23:23 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 11 05:23:23 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Image download 20.69 MB at 20.69 MB/s Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fade26-b6b4-4114-b781-dbda3a75cac2]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:23 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD Jun 11 05:23:23 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:24 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.747s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:24 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:23:24 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Deleted volume successfully. Jun 11 05:23:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-66dd3b6d-a4e1-4b90-85fd-7bdad4f0f090 tempest-VolumesSnapshotNegativeTestJSON-20847922 None] Lock "cinder-4407067b-d448-4ab7-9256-fae0f01dfe91-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Acquiring lock "cinder-16d09795-4ae6-4cc7-83ad-0a494f034528-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Lock "cinder-16d09795-4ae6-4cc7-83ad-0a494f034528-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Acquiring lock "cinder-quobyte-16d09795-4ae6-4cc7-83ad-0a494f034528" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Lock "cinder-quobyte-16d09795-4ae6-4cc7-83ad-0a494f034528" acquired by "delete_volume" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:24 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:24 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Temporary image 5948caf3-a8c7-4db4-a99d-12690a647bd4 is fetched for user 96a976bae424486fa2c8ac4e5e640889. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 11 05:23:24 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7556cf-ab5e-4e2d-82a5-530ccaff60df]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:24 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[062498bd-3045-4f03-8964-70315b2cd901]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:24 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 Jun 11 05:23:24 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:24 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD Jun 11 05:23:24 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:25 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528" returned: 0 in 0.832s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:25 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528 Jun 11 05:23:25 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:25 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD" returned: 0 in 0.767s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1576175652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7be8c4-69ed-44ba-bda9-637bdebc7e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0543cf357ec0460fb52ab6f3cd8aa764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:23:23Z,use_quota=True,user_id='96a976bae424486fa2c8ac4e5e640889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Creating volume 4c7be8c4-69ed-44ba-bda9-637bdebc7e5b {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:23:25 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:23:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:25 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b 1073741824 Jun 11 05:23:25 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:26 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-16d09795-4ae6-4cc7-83ad-0a494f034528" returned: 0 in 0.707s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:26 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Lock "cinder-quobyte-16d09795-4ae6-4cc7-83ad-0a494f034528" released by "delete_volume" :: held 1.633s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:26 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Created reservations ['eb96c002-f4eb-476b-b93a-28de72a7d47d', '3c7d04d0-37d2-4688-8b95-bd246557d2d6', 'b00f6f79-bc91-4791-98f1-6b0c3c20b269', '83a9c354-67ed-437d-bc7e-67dbf611f9e8'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:23:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:23:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:23:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:23:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:23:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:23:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:26 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:23:26 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:26 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b 1073741824" returned: 0 in 0.969s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:26 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b Jun 11 05:23:26 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:27 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.726s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:27 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:23:27 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Deleted volume successfully. Jun 11 05:23:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8a34f808-43cf-462d-9fa4-bfbcec27738b tempest-TestStampPattern-272184299 None] Lock "cinder-16d09795-4ae6-4cc7-83ad-0a494f034528-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:27 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" returned: 0 in 0.831s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:23:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:23:27 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Attempting download of 5948caf3-a8c7-4db4-a99d-12690a647bd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}])) to volume 4c7be8c4-69ed-44ba-bda9-637bdebc7e5b. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 11 05:23:27 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[707df76f-31e4-4db4-882f-30d0595f8866]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_pkigecoj {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:27 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_pkigecoj Jun 11 05:23:27 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:28 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_pkigecoj" returned: 0 in 0.747s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_pkigecoj {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:28 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_pkigecoj Jun 11 05:23:28 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:29 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_pkigecoj" returned: 1 in 0.946s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5948caf3-a8c7-4db4-a99d-12690a647bd4_pkigecoj' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:23:29 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6a7a92-a523-4527-a75a-8a6760f03301]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:29 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD Jun 11 05:23:29 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:23:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:23:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:23:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:23:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:23:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:23:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:30 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:23:30 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:30 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD" returned: 0 in 1.249s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:30 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] 5948caf3-a8c7-4db4-a99d-12690a647bd4 was qcow2, converting to raw {{(pid=92308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 11 05:23:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:30 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b Jun 11 05:23:30 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:31 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.041s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:23:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:23:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:23:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:23:33 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" returned: 0 in 3.303s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:33 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5948caf3-a8c7-4db4-a99d-12690a647bd4_yanuocildevstack@QuobyteHD, size 112.00 MB, duration 3.30 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:23:33 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Converted 112.00 MB image at 33.90 MB/s Jun 11 05:23:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:33 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b 1G Jun 11 05:23:33 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:34 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b 1G" returned: 0 in 1.150s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:34 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b980020c-8701-4774-9039-e48843cd1efa]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:35 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b Jun 11 05:23:35 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:36 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" returned: 0 in 1.040s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:36 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b Jun 11 05:23:36 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:37 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" returned: 1 in 1.205s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:23:37 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Downloaded image 5948caf3-a8c7-4db4-a99d-12690a647bd4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}])) to volume 4c7be8c4-69ed-44ba-bda9-637bdebc7e5b successfully. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 11 05:23:37 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Temporary image 5948caf3-a8c7-4db4-a99d-12690a647bd4 for user 96a976bae424486fa2c8ac4e5e640889 is deleted. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 11 05:23:37 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Marking volume 4c7be8c4-69ed-44ba-bda9-637bdebc7e5b as bootable. {{(pid=92308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 11 05:23:37 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Copying metadata from image 5948caf3-a8c7-4db4-a99d-12690a647bd4 to 4c7be8c4-69ed-44ba-bda9-637bdebc7e5b. {{(pid=92308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 11 05:23:37 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Creating volume glance metadata for volume 4c7be8c4-69ed-44ba-bda9-637bdebc7e5b backed by image 5948caf3-a8c7-4db4-a99d-12690a647bd4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 11 05:23:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7896cb66-7134-4257-a388-70621f441c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b', 'volume_size': 1, 'image_id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5948caf3-a8c7-4db4-a99d-12690a647bd4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fc36ed7ee404444980e7b3d4d23270a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5948caf3-a8c7-4db4-a99d-12690a647bd4', 'created_at': datetime.datetime(2026, 6, 11, 3, 3, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 3, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5948caf3-a8c7-4db4-a99d-12690a647bd4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9d4de5-b15f-4421-9345-15ea241bc99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:37 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Volume volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b (4c7be8c4-69ed-44ba-bda9-637bdebc7e5b): created successfully Jun 11 05:23:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9d4de5-b15f-4421-9345-15ea241bc99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Flow 'volume_create_manager' (bcfbebd8-0f6a-47e2-b5c7-fb1cf8717ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:23:37 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-bd1e1f85-e6f8-4dfb-ade0-129c288d98bc tempest-TestShelveInstance-526872087 None] Created volume successfully. Jun 11 05:23:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-317b820d-f6bb-40b0-88ea-f27785d143b7 tempest-VolumesActionsTest-2067611301 None] Acquiring lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" by "attach_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-317b820d-f6bb-40b0-88ea-f27785d143b7 tempest-VolumesActionsTest-2067611301 None] Lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" acquired by "attach_volume" :: waited 0.029s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:39 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-317b820d-f6bb-40b0-88ea-f27785d143b7 tempest-VolumesActionsTest-2067611301 None] Attaching volume 8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 to instance e46228d1-4ae6-4659-ab36-820642809683 at mountpoint /dev/vdb on host None. Jun 11 05:23:39 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-317b820d-f6bb-40b0-88ea-f27785d143b7 tempest-VolumesActionsTest-2067611301 None] Attach volume completed successfully. Jun 11 05:23:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-317b820d-f6bb-40b0-88ea-f27785d143b7 tempest-VolumesActionsTest-2067611301 None] Lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" released by "attach_volume" :: held 0.124s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9c8a8214-c32f-429c-ac06-4e3c28237746 tempest-VolumesActionsTest-2067611301 None] Acquiring lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332-detach_volume" by "detach_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:23:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9c8a8214-c32f-429c-ac06-4e3c28237746 tempest-VolumesActionsTest-2067611301 None] Lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:23:40 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9c8a8214-c32f-429c-ac06-4e3c28237746 tempest-VolumesActionsTest-2067611301 None] Detaching volume 8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 from instance e46228d1-4ae6-4659-ab36-820642809683. Jun 11 05:23:40 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9c8a8214-c32f-429c-ac06-4e3c28237746 tempest-VolumesActionsTest-2067611301 None] Detach volume completed successfully. Jun 11 05:23:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9c8a8214-c32f-429c-ac06-4e3c28237746 tempest-VolumesActionsTest-2067611301 None] Lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332-detach_volume" released by "detach_volume" :: held 0.144s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:23:48 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=64,cinder:UPDATE=59,cinder:INSERT=18,cinder:DELETE=4 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:23:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-3f0e051b-910a-45f9-abd4-b25655d0cb4a req-d9eedec5-c51b-4f49-9473-949033f56419 tempest-TestShelveInstance-526872087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:23:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-3f0e051b-910a-45f9-abd4-b25655d0cb4a req-d9eedec5-c51b-4f49-9473-949033f56419 tempest-TestShelveInstance-526872087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:23:48 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bfa941-f7a2-4449-850d-09bdff130196]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-3f0e051b-910a-45f9-abd4-b25655d0cb4a req-d9eedec5-c51b-4f49-9473-949033f56419 tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:48 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b Jun 11 05:23:48 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:49 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-3f0e051b-910a-45f9-abd4-b25655d0cb4a req-d9eedec5-c51b-4f49-9473-949033f56419 tempest-TestShelveInstance-526872087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" returned: 0 in 1.371s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-3f0e051b-910a-45f9-abd4-b25655d0cb4a req-d9eedec5-c51b-4f49-9473-949033f56419 tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:49 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b Jun 11 05:23:49 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:50 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-3f0e051b-910a-45f9-abd4-b25655d0cb4a req-d9eedec5-c51b-4f49-9473-949033f56419 tempest-TestShelveInstance-526872087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" returned: 1 in 0.846s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-3f0e051b-910a-45f9-abd4-b25655d0cb4a req-d9eedec5-c51b-4f49-9473-949033f56419 tempest-TestShelveInstance-526872087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:23:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-3f0e051b-910a-45f9-abd4-b25655d0cb4a req-d9eedec5-c51b-4f49-9473-949033f56419 tempest-TestShelveInstance-526872087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.290s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:23:50 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-3f0e051b-910a-45f9-abd4-b25655d0cb4a req-d9eedec5-c51b-4f49-9473-949033f56419 tempest-TestShelveInstance-526872087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1b645c8-bb28-47e2-8e8d-5ff9f09f6136', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:23:50 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-3f0e051b-910a-45f9-abd4-b25655d0cb4a req-d9eedec5-c51b-4f49-9473-949033f56419 tempest-TestShelveInstance-526872087 None] attachment_update completed successfully. Jun 11 05:23:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:23:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:23:50 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[635269c6-79f7-4b41-8be7-7823d91ce9da]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:50 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 Jun 11 05:23:50 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Flow 'volume_create_manager' (23bb28b2-6689-4758-9535-29518fcbb840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4afe0e-6de4-4d1f-b5ac-9b7805a37c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4afe0e-6de4-4d1f-b5ac-9b7805a37c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1073ca-c605-44dc-8f4b-c05d72367318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f93afa66c0c43c1bbb284c4c332993f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:23:51Z,use_quota=True,user_id='758c9970a1d5457493cc5d7a02ac67c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5d7f1f3-b7e0-4bf7-a4b6-f4946df62421),volume_type_id=a5d7f1f3-b7e0-4bf7-a4b6-f4946df62421)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f90a11-7d99-408f-b44b-9b202f3ada8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f90a11-7d99-408f-b44b-9b202f3ada8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1537555-ec4b-40dc-bc9e-93f1001e20c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG cinder.image.glance [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Creating Keystone auth plugin from conf {{(pid=92308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 11 05:23:51 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" returned: 0 in 0.970s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebc133c-beb3-4b94-b8d2-fbc9a3a1f95f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:51 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 Jun 11 05:23:51 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1537555-ec4b-40dc-bc9e-93f1001e20c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c1073ca-c605-44dc-8f4b-c05d72367318', 'volume_name': 'volume-4c1073ca-c605-44dc-8f4b-c05d72367318', 'volume_size': 1, 'image_id': 'c0c66068-9b12-4828-92cf-51f0edb78586', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0c66068-9b12-4828-92cf-51f0edb78586', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1ee52fea1a2412ff45ec6bddd9fb3d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f93afa66c0c43c1bbb284c4c332993f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3315390fb1a0806709307be7e2e37fb171c359c9d470cd09989f56d5e6af0e2aac9b790e7e062d739e71d4884d62847468efff351b0ac6e816851c715d733901', 'id': 'c0c66068-9b12-4828-92cf-51f0edb78586', 'created_at': datetime.datetime(2026, 6, 11, 3, 23, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 23, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0c66068-9b12-4828-92cf-51f0edb78586/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34b0523-d95c-4a29-8738-35c2f2093a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34b0523-d95c-4a29-8738-35c2f2093a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb291196-4b72-45d9-97ed-9b1f399e6fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:23:51 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Volume 4c1073ca-c605-44dc-8f4b-c05d72367318: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c1073ca-c605-44dc-8f4b-c05d72367318', 'volume_size': 1, 'image_id': 'c0c66068-9b12-4828-92cf-51f0edb78586', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0c66068-9b12-4828-92cf-51f0edb78586', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1ee52fea1a2412ff45ec6bddd9fb3d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f93afa66c0c43c1bbb284c4c332993f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3315390fb1a0806709307be7e2e37fb171c359c9d470cd09989f56d5e6af0e2aac9b790e7e062d739e71d4884d62847468efff351b0ac6e816851c715d733901', 'id': 'c0c66068-9b12-4828-92cf-51f0edb78586', 'created_at': datetime.datetime(2026, 6, 11, 3, 23, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 23, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0c66068-9b12-4828-92cf-51f0edb78586/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 11 05:23:51 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Trying to clone 4c1073ca-c605-44dc-8f4b-c05d72367318 from image c0c66068-9b12-4828-92cf-51f0edb78586 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c0c66068-9b12-4828-92cf-51f0edb78586', 'metadata': {}}]). {{(pid=92308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 11 05:23:52 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 11 05:23:52 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Image download 0.00 MB at 0.00 MB/s Jun 11 05:23:52 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7029a2fe-7c12-4ce9-b360-8ef84bd073f1]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:52 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD Jun 11 05:23:52 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:52 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" returned: 0 in 1.047s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.0b7dbb9d-9f1a-4bcd-ae95-32cdceeaa5d4xwggmwv1.img {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:52 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.0b7dbb9d-9f1a-4bcd-ae95-32cdceeaa5d4xwggmwv1.img Jun 11 05:23:52 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:53 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD" returned: 0 in 0.980s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:53 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD Jun 11 05:23:53 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:55 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD" returned: 1 in 2.170s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:23:55 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Temporary image c0c66068-9b12-4828-92cf-51f0edb78586 is fetched for user 758c9970a1d5457493cc5d7a02ac67c7. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 11 05:23:55 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8c0518-1c13-4889-a207-6780bbe40505]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:23:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:55 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD Jun 11 05:23:55 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:57 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD" returned: 0 in 2.447s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:23:58 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD Jun 11 05:23:58 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:23:59 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD" returned: 1 in 1.932s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:23:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:23:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:23:59 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jun 11 05:23:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.0b7dbb9d-9f1a-4bcd-ae95-32cdceeaa5d4xwggmwv1.img" returned: 0 in 7.341s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d577ef5f-0dfb-4de8-aafe-b1a3ea7031b2]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:00 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 Jun 11 05:24:00 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:01 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" returned: 0 in 1.324s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:01 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.0b7dbb9d-9f1a-4bcd-ae95-32cdceeaa5d4xwggmwv1.img {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:24:01 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] Converted 1024.00 MB image at 139.46 MB/s Jun 11 05:24:01 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=67,cinder:INSERT=24,cinder:UPDATE=47,cinder:DELETE=3 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:24:01 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] 0b7dbb9d-9f1a-4bcd-ae95-32cdceeaa5d4 was raw, no need to convert to raw {{(pid=92308) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 11 05:24:11 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:24:24 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:24:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Flow 'volume_create_manager' (c529f82e-ba30-44b7-a0d4-de3b3772aed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:24:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e37fca-62b4-4b09-b311-d89b1c12873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e37fca-62b4-4b09-b311-d89b1c12873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-174920942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8e600e-618c-47ec-943b-7334f9afe22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114f55338eb94c569fb8456c2f9a72ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:24:25Z,use_quota=True,user_id='e1a1cf28b53a4596ae8abc3bed36cfb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b96534-ac54-4786-b0dd-68dacb1566de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b96534-ac54-4786-b0dd-68dacb1566de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc3b0f7-4b53-4a99-ad5f-139a20ff3e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc3b0f7-4b53-4a99-ad5f-139a20ff3e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e8e600e-618c-47ec-943b-7334f9afe22e', 'volume_name': 'volume-5e8e600e-618c-47ec-943b-7334f9afe22e', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6c87f8-0ac5-4df0-877c-0471c88b63a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6c87f8-0ac5-4df0-877c-0471c88b63a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743f00e1-08fb-46f7-8351-54e8e3d55a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:25 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Volume 5e8e600e-618c-47ec-943b-7334f9afe22e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e8e600e-618c-47ec-943b-7334f9afe22e', 'volume_size': 1} Jun 11 05:24:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:24:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.189s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:24:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] Uploaded volume to glance image-id: 0b7dbb9d-9f1a-4bcd-ae95-32cdceeaa5d4. {{(pid=92308) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 11 05:24:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.867s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:24:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1073ca-c605-44dc-8f4b-c05d72367318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f93afa66c0c43c1bbb284c4c332993f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:23:51Z,use_quota=True,user_id='758c9970a1d5457493cc5d7a02ac67c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5d7f1f3-b7e0-4bf7-a4b6-f4946df62421),volume_type_id=a5d7f1f3-b7e0-4bf7-a4b6-f4946df62421)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:24:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Creating volume 4c1073ca-c605-44dc-8f4b-c05d72367318 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:24:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:24:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:24:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:24:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:24:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:24:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:24:26 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:24:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:26 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-d45cc986-1f45-417e-8c1b-7096bd005658 tempest-VolumesActionsTest-2067611301 None] Copy volume to image completed successfully. Jun 11 05:24:26 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 1073741824 Jun 11 05:24:26 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:27 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 1073741824" returned: 0 in 1.046s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:27 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 Jun 11 05:24:27 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:24:28 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318" returned: 0 in 0.954s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.759s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-174920942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8e600e-618c-47ec-943b-7334f9afe22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114f55338eb94c569fb8456c2f9a72ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:24:25Z,use_quota=True,user_id='e1a1cf28b53a4596ae8abc3bed36cfb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Creating volume 5e8e600e-618c-47ec-943b-7334f9afe22e {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:24:28 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:28 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e 1073741824 Jun 11 05:24:28 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Attempting download of c0c66068-9b12-4828-92cf-51f0edb78586 ((None, [{'url': 'file:///opt/stack/data/glance/images/c0c66068-9b12-4828-92cf-51f0edb78586', 'metadata': {}}])) to volume 4c1073ca-c605-44dc-8f4b-c05d72367318. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cabe58c-fd74-4534-a3e8-775ebadd1f8a]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0c66068-9b12-4828-92cf-51f0edb78586_ltxz6f77 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:29 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0c66068-9b12-4828-92cf-51f0edb78586_ltxz6f77 Jun 11 05:24:29 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:29 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:29 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e 1073741824" returned: 0 in 0.925s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0c66068-9b12-4828-92cf-51f0edb78586_ltxz6f77" returned: 0 in 0.843s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0c66068-9b12-4828-92cf-51f0edb78586_ltxz6f77 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:29 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e Jun 11 05:24:29 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:29 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0c66068-9b12-4828-92cf-51f0edb78586_ltxz6f77 Jun 11 05:24:29 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:30 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:24:30 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:30 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0c66068-9b12-4828-92cf-51f0edb78586_ltxz6f77" returned: 1 in 0.777s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0c66068-9b12-4828-92cf-51f0edb78586_ltxz6f77' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fdece7-2dec-48f7-a759-a5f941b77225]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:30 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD Jun 11 05:24:30 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:30 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e" returned: 0 in 0.999s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.425s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743f00e1-08fb-46f7-8351-54e8e3d55a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8e600e-618c-47ec-943b-7334f9afe22e', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503edeef-e69c-4c82-a897-27a73175e19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff213846-98bf-4342-af2f-55ac132e0f3c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:30 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Volume volume-5e8e600e-618c-47ec-943b-7334f9afe22e (5e8e600e-618c-47ec-943b-7334f9afe22e): created successfully Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503edeef-e69c-4c82-a897-27a73175e19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Flow 'volume_create_manager' (c529f82e-ba30-44b7-a0d4-de3b3772aed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:24:30 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5291cc01-9061-464c-9dc0-5a8adc222af4 tempest-TestMinimumBasicScenario-114295726 None] Created volume successfully. Jun 11 05:24:31 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 Jun 11 05:24:31 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:31 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD" returned: 0 in 1.092s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:31 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.452s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:24:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:24:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:24:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:24:31 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD Jun 11 05:24:31 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:32 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" returned: 0 in 1.286s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:32 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[db63f025-e302-455c-b27a-c09e2511b475]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:32 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 Jun 11 05:24:32 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:32 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD" returned: 1 in 1.008s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:24:32 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] c0c66068-9b12-4828-92cf-51f0edb78586 was raw, converting to raw {{(pid=92308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 11 05:24:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:32 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 Jun 11 05:24:32 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:33 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-ce958b13-6d66-4985-82ae-f6aea17192e8 req-aaf081f5-715a-4c89-a5ab-e13017b02641 tempest-TestShelveInstance-526872087 None] Terminate volume connection completed successfully. Jun 11 05:24:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-ce958b13-6d66-4985-82ae-f6aea17192e8 req-aaf081f5-715a-4c89-a5ab-e13017b02641 tempest-TestShelveInstance-526872087 None] Deleting attachment d1b645c8-bb28-47e2-8e8d-5ff9f09f6136. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:24:33 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" returned: 0 in 0.958s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:33 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img Jun 11 05:24:33 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:33 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318" returned: 0 in 1.020s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:33 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c0c66068-9b12-4828-92cf-51f0edb78586_a0nfkxzmdevstack@QuobyteHD, size 0.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:24:33 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Converted 0.00 MB image at 0.00 MB/s Jun 11 05:24:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:33 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 1G Jun 11 05:24:33 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:35 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 1G" returned: 0 in 1.905s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:35 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01d7ca3-5c11-497e-bb68-cd3e352df99a]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-4df8ecd5-2f1f-4055-b60f-d765ba36df5b req-fc1ed8d1-fc25-47f8-aab1-763f4291f3cb tempest-TestMinimumBasicScenario-114295726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:24:35 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 Jun 11 05:24:35 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:37 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318" returned: 0 in 1.817s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:37 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 Jun 11 05:24:37 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:39 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318" returned: 1 in 1.751s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Downloaded image c0c66068-9b12-4828-92cf-51f0edb78586 ((None, [{'url': 'file:///opt/stack/data/glance/images/c0c66068-9b12-4828-92cf-51f0edb78586', 'metadata': {}}])) to volume 4c1073ca-c605-44dc-8f4b-c05d72367318 successfully. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Temporary image c0c66068-9b12-4828-92cf-51f0edb78586 for user 758c9970a1d5457493cc5d7a02ac67c7 is deleted. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Marking volume 4c1073ca-c605-44dc-8f4b-c05d72367318 as bootable. {{(pid=92308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Copying metadata from image c0c66068-9b12-4828-92cf-51f0edb78586 to 4c1073ca-c605-44dc-8f4b-c05d72367318. {{(pid=92308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Creating volume glance metadata for volume 4c1073ca-c605-44dc-8f4b-c05d72367318 backed by image c0c66068-9b12-4828-92cf-51f0edb78586 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c0c66068-9b12-4828-92cf-51f0edb78586', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e1ee52fea1a2412ff45ec6bddd9fb3d9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb291196-4b72-45d9-97ed-9b1f399e6fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1073ca-c605-44dc-8f4b-c05d72367318', 'volume_size': 1, 'image_id': 'c0c66068-9b12-4828-92cf-51f0edb78586', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0c66068-9b12-4828-92cf-51f0edb78586', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1ee52fea1a2412ff45ec6bddd9fb3d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f93afa66c0c43c1bbb284c4c332993f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3315390fb1a0806709307be7e2e37fb171c359c9d470cd09989f56d5e6af0e2aac9b790e7e062d739e71d4884d62847468efff351b0ac6e816851c715d733901', 'id': 'c0c66068-9b12-4828-92cf-51f0edb78586', 'created_at': datetime.datetime(2026, 6, 11, 3, 23, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 23, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0c66068-9b12-4828-92cf-51f0edb78586/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef39e993-9410-443f-bd87-e65a5ddf0a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:39 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Volume volume-4c1073ca-c605-44dc-8f4b-c05d72367318 (4c1073ca-c605-44dc-8f4b-c05d72367318): created successfully Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef39e993-9410-443f-bd87-e65a5ddf0a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Flow 'volume_create_manager' (23bb28b2-6689-4758-9535-29518fcbb840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:24:39 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2f94f33c-4bc0-4092-b362-bbe93b7f816c tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Created volume successfully. Jun 11 05:24:39 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img" returned: 0 in 6.494s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[458ddf9d-7ddd-43ff-ae45-807d20daaf2c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:39 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 Jun 11 05:24:39 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-7049ffff-106e-4da5-86ee-04f6edd9ad64 req-4fff8d9c-08ba-4a97-bebd-2fbf8e6fe43a tempest-TestShelveInstance-526872087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:24:40 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" returned: 0 in 0.856s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:40 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:24:40 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Converted 1024.00 MB image at 157.64 MB/s Jun 11 05:24:40 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f was raw, converting to qcow2 {{(pid=92308) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 11 05:24:40 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[028a07e4-b391-4c75-87a5-cdfb080e3687]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:40 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img Jun 11 05:24:40 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:41 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img" returned: 0 in 0.647s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:41 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img Jun 11 05:24:41 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:41 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img" returned: 1 in 0.677s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:24:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img /opt/stack/data/cinder/conversion/vol_upload_w2e4nbz6 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:41 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img /opt/stack/data/cinder/conversion/vol_upload_w2e4nbz6 Jun 11 05:24:41 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:42 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img /opt/stack/data/cinder/conversion/vol_upload_w2e4nbz6" returned: 0 in 0.606s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:42 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Image conversion details: src /opt/stack/data/cinder/conversion/8fef9c36-c6f8-42a5-80ea-8bce4f4b3332.temp_image.d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f6x6f_t50.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_w2e4nbz6 {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:24:42 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 11 05:24:42 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3b997c-caff-46da-8701-2a4cae7b9eca]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w2e4nbz6 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:42 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w2e4nbz6 Jun 11 05:24:42 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:43 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w2e4nbz6" returned: 0 in 0.683s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.570s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:24:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Uploaded volume to glance image-id: d5227ae9-dac8-48b2-8e15-4b5fe5c07c6f. {{(pid=92308) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 11 05:24:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-4df8ecd5-2f1f-4055-b60f-d765ba36df5b req-fc1ed8d1-fc25-47f8-aab1-763f4291f3cb tempest-TestMinimumBasicScenario-114295726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.543s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:24:44 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed605bf-9ef9-495e-bb1a-9d5311020292]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-4df8ecd5-2f1f-4055-b60f-d765ba36df5b req-fc1ed8d1-fc25-47f8-aab1-763f4291f3cb tempest-TestMinimumBasicScenario-114295726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:44 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c2b93b52-8191-4846-88f2-700637c80655 tempest-VolumesActionsTest-2067611301 None] Copy volume to image completed successfully. Jun 11 05:24:44 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e Jun 11 05:24:44 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:45 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-4df8ecd5-2f1f-4055-b60f-d765ba36df5b req-fc1ed8d1-fc25-47f8-aab1-763f4291f3cb tempest-TestMinimumBasicScenario-114295726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e" returned: 0 in 0.724s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-4df8ecd5-2f1f-4055-b60f-d765ba36df5b req-fc1ed8d1-fc25-47f8-aab1-763f4291f3cb tempest-TestMinimumBasicScenario-114295726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.751s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:24:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-7049ffff-106e-4da5-86ee-04f6edd9ad64 req-4fff8d9c-08ba-4a97-bebd-2fbf8e6fe43a tempest-TestShelveInstance-526872087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.260s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:24:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-4df8ecd5-2f1f-4055-b60f-d765ba36df5b req-fc1ed8d1-fc25-47f8-aab1-763f4291f3cb tempest-TestMinimumBasicScenario-114295726 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-5e8e600e-618c-47ec-943b-7334f9afe22e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22e7d04b-04fe-4898-9b8a-271860a3f105', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:24:45 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a55bd0e-22d7-4eb2-be40-7e9b8aeb4556]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-7049ffff-106e-4da5-86ee-04f6edd9ad64 req-4fff8d9c-08ba-4a97-bebd-2fbf8e6fe43a tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:45 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-4df8ecd5-2f1f-4055-b60f-d765ba36df5b req-fc1ed8d1-fc25-47f8-aab1-763f4291f3cb tempest-TestMinimumBasicScenario-114295726 None] attachment_update completed successfully. Jun 11 05:24:45 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b Jun 11 05:24:45 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Acquiring lock "cinder-4c1073ca-c605-44dc-8f4b-c05d72367318-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:24:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Lock "cinder-4c1073ca-c605-44dc-8f4b-c05d72367318-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:24:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Acquiring lock "cinder-quobyte-4c1073ca-c605-44dc-8f4b-c05d72367318" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:24:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Lock "cinder-quobyte-4c1073ca-c605-44dc-8f4b-c05d72367318" acquired by "delete_volume" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:24:45 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a172b9-3e51-4b33-9f6c-dc3fc2dc3ee6]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:45 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 Jun 11 05:24:45 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:46 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-7049ffff-106e-4da5-86ee-04f6edd9ad64 req-4fff8d9c-08ba-4a97-bebd-2fbf8e6fe43a tempest-TestShelveInstance-526872087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" returned: 0 in 0.860s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-7049ffff-106e-4da5-86ee-04f6edd9ad64 req-4fff8d9c-08ba-4a97-bebd-2fbf8e6fe43a tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:46 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b Jun 11 05:24:46 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Acquiring lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:24:46 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:46 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:24:46 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Acquiring lock "cinder-quobyte-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:24:46 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Lock "cinder-quobyte-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" acquired by "delete_volume" :: waited 0.014s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:24:46 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b05f13b-f69c-484d-9834-0f7ed55062ac]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:46 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 Jun 11 05:24:46 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:46 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318" returned: 0 in 0.898s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:46 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 Jun 11 05:24:46 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:47 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-7049ffff-106e-4da5-86ee-04f6edd9ad64 req-4fff8d9c-08ba-4a97-bebd-2fbf8e6fe43a tempest-TestShelveInstance-526872087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" returned: 1 in 0.973s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-7049ffff-106e-4da5-86ee-04f6edd9ad64 req-4fff8d9c-08ba-4a97-bebd-2fbf8e6fe43a tempest-TestShelveInstance-526872087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:24:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-7049ffff-106e-4da5-86ee-04f6edd9ad64 req-4fff8d9c-08ba-4a97-bebd-2fbf8e6fe43a tempest-TestShelveInstance-526872087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.878s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:24:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-7049ffff-106e-4da5-86ee-04f6edd9ad64 req-4fff8d9c-08ba-4a97-bebd-2fbf8e6fe43a tempest-TestShelveInstance-526872087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d7b12c9-6568-4957-8f7d-09ec4ca36b29', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:24:47 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-7049ffff-106e-4da5-86ee-04f6edd9ad64 req-4fff8d9c-08ba-4a97-bebd-2fbf8e6fe43a tempest-TestShelveInstance-526872087 None] attachment_update completed successfully. Jun 11 05:24:47 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" returned: 0 in 0.906s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:47 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332 Jun 11 05:24:47 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:47 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318" returned: 1 in 0.743s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:24:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:47 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318 Jun 11 05:24:47 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:47 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" returned: 0 in 0.623s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Lock "cinder-quobyte-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332" released by "delete_volume" :: held 1.573s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:24:47 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Created reservations ['7e847f41-4f55-4bf9-a3f0-9a473f59575f', 'a875cb41-b827-4ef9-b4a8-b96a22f9526e', 'f4496c4d-fb8b-4c34-9323-fbaffb692d84', 'e8695549-f6d7-4c9c-8770-8a0949aa4610'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:24:48 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c1073ca-c605-44dc-8f4b-c05d72367318" returned: 0 in 0.635s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Lock "cinder-quobyte-4c1073ca-c605-44dc-8f4b-c05d72367318" released by "delete_volume" :: held 2.389s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:24:48 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:24:48 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:48 devstack cinder-volume[92308]: WARNING cinder.quota [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:24:48 devstack cinder-volume[92308]: WARNING cinder.quota [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Created reservations ['aa807135-f7a3-4870-b10c-c1decafe5024', '321b6f69-da64-4706-b9e2-baa76ed2c161', 'e596aab1-e5ff-45ce-8807-6ea7b8ed79e5', 'f5b7cef4-7358-4c71-9485-362210549f71'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:48 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:24:48 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:48 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.813s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:24:48 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Deleted volume successfully. Jun 11 05:24:48 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-513f946e-0b10-42b3-b43a-2a1bbccda48a tempest-VolumesActionsTest-2067611301 None] Lock "cinder-8fef9c36-c6f8-42a5-80ea-8bce4f4b3332-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:24:49 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.853s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:49 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:24:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Deleted volume successfully. Jun 11 05:24:49 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-83c202cb-6a0d-4119-bec1-acc0036a6351 tempest-VolumeAndVolumeTypeFromImageTest-1609807633 None] Lock "cinder-4c1073ca-c605-44dc-8f4b-c05d72367318-delete_volume" released by "delete_volume" :: held 3.482s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Flow 'volume_create_manager' (609b0b99-90eb-4c94-bb0c-4c67d98cd911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd8b056-e7d5-4296-802d-cb45b954c849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd8b056-e7d5-4296-802d-cb45b954c849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1145090692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2842ae5b-9739-467a-96f9-8777ea245838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01df8ac68e0c4892bb556e4c56ff418a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:24:56Z,use_quota=True,user_id='7801ce10e1534a1f85dd22e5aea3d2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e591a3cf-a577-4fcb-a23c-404b5969b51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e591a3cf-a577-4fcb-a23c-404b5969b51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87397c0-d7b8-4cd9-bf61-98f5203e4c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87397c0-d7b8-4cd9-bf61-98f5203e4c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2842ae5b-9739-467a-96f9-8777ea245838', 'volume_name': 'volume-2842ae5b-9739-467a-96f9-8777ea245838', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7e7c2a-28aa-44d7-b042-5dd69c499488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7e7c2a-28aa-44d7-b042-5dd69c499488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadaf268-db12-4739-a205-c7a205868b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:56 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Volume 2842ae5b-9739-467a-96f9-8777ea245838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2842ae5b-9739-467a-96f9-8777ea245838', 'volume_size': 1} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1145090692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2842ae5b-9739-467a-96f9-8777ea245838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01df8ac68e0c4892bb556e4c56ff418a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:24:56Z,use_quota=True,user_id='7801ce10e1534a1f85dd22e5aea3d2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Creating volume 2842ae5b-9739-467a-96f9-8777ea245838 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:24:56 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:24:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:56 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 1073741824 Jun 11 05:24:56 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:57 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 1073741824" returned: 0 in 0.874s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:57 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 Jun 11 05:24:57 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:24:58 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jun 11 05:24:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838" returned: 0 in 0.700s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:24:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:24:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:24:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadaf268-db12-4739-a205-c7a205868b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2842ae5b-9739-467a-96f9-8777ea245838', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fd7bad-d6f2-4404-a3bb-767cd195eb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:58 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Volume volume-2842ae5b-9739-467a-96f9-8777ea245838 (2842ae5b-9739-467a-96f9-8777ea245838): created successfully Jun 11 05:24:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fd7bad-d6f2-4404-a3bb-767cd195eb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Flow 'volume_create_manager' (609b0b99-90eb-4c94-bb0c-4c67d98cd911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:24:58 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-bce896c3-710f-44ed-8a16-7c67dc6817e2 tempest-VolumesCloneTest-990657326 None] Created volume successfully. Jun 11 05:24:58 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Flow 'volume_create_manager' (329230c2-d898-4106-a41c-32f7f36a7051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545f05b6-d318-47a1-af6d-d53a19887bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545f05b6-d318-47a1-af6d-d53a19887bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-242432036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baace63b-a457-445a-b297-aa790982b929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01df8ac68e0c4892bb556e4c56ff418a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:24:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2842ae5b-9739-467a-96f9-8777ea245838,status='creating',terminated_at=None,updated_at=2026-06-11T03:24:59Z,use_quota=True,user_id='7801ce10e1534a1f85dd22e5aea3d2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe04a053-ecf3-40a0-a1dc-9448a5160774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe04a053-ecf3-40a0-a1dc-9448a5160774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d98f000-c0c3-4d01-ba2a-714c379dbacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d98f000-c0c3-4d01-ba2a-714c379dbacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'baace63b-a457-445a-b297-aa790982b929', 'volume_name': 'volume-baace63b-a457-445a-b297-aa790982b929', 'volume_size': 2, 'source_volid': '2842ae5b-9739-467a-96f9-8777ea245838', 'source_volstatus': 'available'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba93dd2-945b-43b2-979b-645c18ba9b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba93dd2-945b-43b2-979b-645c18ba9b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162eb7df-474a-4d7f-87d0-b29a48a2a399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:24:59 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Volume baace63b-a457-445a-b297-aa790982b929: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-baace63b-a457-445a-b297-aa790982b929', 'volume_size': 2, 'source_volid': '2842ae5b-9739-467a-96f9-8777ea245838', 'source_volstatus': 'available'} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:24:59 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Cloning volume 2842ae5b-9739-467a-96f9-8777ea245838 to volume baace63b-a457-445a-b297-aa790982b929 Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Creating offline snapshot f7459aba-0578-4dc4-b3f4-16401da11864 of volume 2842ae5b-9739-467a-96f9-8777ea245838 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4661e957-4aee-4880-997e-d637c08eabd4]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:24:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:24:59 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 Jun 11 05:24:59 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:00 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838" returned: 0 in 1.042s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:00 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 1G Jun 11 05:25:00 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:01 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 1G" returned: 0 in 0.896s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2842ae5b-9739-467a-96f9-8777ea245838 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:01 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2842ae5b-9739-467a-96f9-8777ea245838 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 Jun 11 05:25:01 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:01 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2842ae5b-9739-467a-96f9-8777ea245838 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864" returned: 0 in 0.685s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:01 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 is being set with open permissions: ugo+rw Jun 11 05:25:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:01 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 Jun 11 05:25:01 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:02 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864" returned: 0 in 0.678s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:02 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.info Jun 11 05:25:02 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:03 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.info" returned: 0 in 0.674s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:03 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.info is being set with open permissions: ugo+rw Jun 11 05:25:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:03 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.info Jun 11 05:25:03 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:03 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.info" returned: 0 in 0.634s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:03 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Acquiring lock "cinder-quobyte-baace63b-a457-445a-b297-aa790982b929" by "_copy_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:25:03 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Lock "cinder-quobyte-baace63b-a457-445a-b297-aa790982b929" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:25:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] snapshot: f7459aba-0578-4dc4-b3f4-16401da11864, volume: baace63b-a457-445a-b297-aa790982b929, {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 11 05:25:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:25:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:25:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:25:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:25:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:25:03 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95f7ffc-e58f-40bc-90f8-6db858783cea]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:25:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:04 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 Jun 11 05:25:04 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:04 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864" returned: 0 in 0.757s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2842ae5b-9739-467a-96f9-8777ea245838(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:25:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] will copy from snapshot at /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 11 05:25:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Creating direct copy from snapshot {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 11 05:25:04 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db53953-c3bd-4192-9a38-b071408faf7d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:25:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:04 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 Jun 11 05:25:04 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:05 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838" returned: 0 in 0.809s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:05 devstack cinder-volume[92308]: DEBUG cinder.utils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Path /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929 not found in is_blk_device check {{(pid=92308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 11 05:25:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:05 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929 Jun 11 05:25:05 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:12 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=34,cinder:UPDATE=33,cinder:INSERT=14,cinder:DELETE=4 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:25:12 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=30,cinder:SELECT=44,cinder:INSERT=8,cinder:DELETE=1 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:25:13 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929" returned: 0 in 8.218s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:13 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cd6b2a-25ea-4fc9-8300-95c1cdefda87]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:25:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:13 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 Jun 11 05:25:13 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:14 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838" returned: 0 in 0.977s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:14 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838, size 1024.00 MB, duration 8.22 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929 {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:25:14 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Converted 1024.00 MB image at 124.59 MB/s Jun 11 05:25:14 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929 is being set with open permissions: ugo+rw Jun 11 05:25:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:14 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929 Jun 11 05:25:14 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:15 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929" returned: 0 in 0.626s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Lock "cinder-quobyte-baace63b-a457-445a-b297-aa790982b929" released by "_copy_volume_from_snapshot" :: held 11.472s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:25:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Acquiring lock "cinder-quobyte-f7459aba-0578-4dc4-b3f4-16401da11864" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:25:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Lock "cinder-quobyte-f7459aba-0578-4dc4-b3f4-16401da11864" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:25:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Deleting offline snapshot f7459aba-0578-4dc4-b3f4-16401da11864 of volume 2842ae5b-9739-467a-96f9-8777ea245838 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:25:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] snapshot_file for this snap is: volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:25:15 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5980f5-391d-4d50-ad0b-cc49520fa74c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:25:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:15 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 Jun 11 05:25:15 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:16 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864" returned: 0 in 0.778s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:16 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2842ae5b-9739-467a-96f9-8777ea245838(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:25:16 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[987fd9b3-065c-4f26-acbd-7b6cde5ae54b]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:25:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:16 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 Jun 11 05:25:16 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:17 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838" returned: 0 in 0.702s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:17 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 Jun 11 05:25:17 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:17 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864" returned: 0 in 0.705s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:17 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864 Jun 11 05:25:17 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:18 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838.f7459aba-0578-4dc4-b3f4-16401da11864" returned: 0 in 0.589s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Lock "cinder-quobyte-f7459aba-0578-4dc4-b3f4-16401da11864" released by "_delete_snapshot" :: held 2.884s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:25:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.216s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:25:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162eb7df-474a-4d7f-87d0-b29a48a2a399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baace63b-a457-445a-b297-aa790982b929', 'volume_size': 2, 'source_volid': '2842ae5b-9739-467a-96f9-8777ea245838', 'source_volstatus': 'available'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:25:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c9985e-99cd-438a-b381-f6d1c13cffd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:25:18 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Volume volume-baace63b-a457-445a-b297-aa790982b929 (baace63b-a457-445a-b297-aa790982b929): created successfully Jun 11 05:25:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c9985e-99cd-438a-b381-f6d1c13cffd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:25:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Flow 'volume_create_manager' (329230c2-d898-4106-a41c-32f7f36a7051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:25:18 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-107a6404-b1d4-4d0e-8ed1-940d6e41b351 tempest-VolumesCloneTest-990657326 None] Created volume successfully. Jun 11 05:25:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Acquiring lock "cinder-baace63b-a457-445a-b297-aa790982b929-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:25:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Lock "cinder-baace63b-a457-445a-b297-aa790982b929-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:25:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Acquiring lock "cinder-quobyte-baace63b-a457-445a-b297-aa790982b929" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:25:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Lock "cinder-quobyte-baace63b-a457-445a-b297-aa790982b929" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:25:19 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef22693-1926-473c-8fc7-d151440b7088]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:25:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:19 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929 Jun 11 05:25:19 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:20 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929" returned: 0 in 0.691s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:20 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929 Jun 11 05:25:20 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:20 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-baace63b-a457-445a-b297-aa790982b929" returned: 0 in 0.607s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Lock "cinder-quobyte-baace63b-a457-445a-b297-aa790982b929" released by "delete_volume" :: held 1.341s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:25:20 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Created reservations ['db05584a-504f-42eb-b1e9-02f853d3985a', '723d5849-d830-426c-91aa-ed9c1a6e8999', 'c74ee04d-5637-49ca-957d-05828836a248', '9d4a1dea-69dc-4e28-a464-bc34f9d5809d'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:25:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:25:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:25:20 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:25:20 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:25:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:25:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:21 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:25:21 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:21 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.573s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:21 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:25:21 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Deleted volume successfully. Jun 11 05:25:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b3d68ff5-fa70-4ae9-a846-081cc05603b2 tempest-VolumesCloneTest-990657326 None] Lock "cinder-baace63b-a457-445a-b297-aa790982b929-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:25:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Acquiring lock "cinder-2842ae5b-9739-467a-96f9-8777ea245838-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:25:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Lock "cinder-2842ae5b-9739-467a-96f9-8777ea245838-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:25:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Acquiring lock "cinder-quobyte-2842ae5b-9739-467a-96f9-8777ea245838" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:25:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Lock "cinder-quobyte-2842ae5b-9739-467a-96f9-8777ea245838" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:25:21 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[179e71cf-346a-44d2-af38-a426c66c9551]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:25:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:21 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 Jun 11 05:25:21 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:22 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838" returned: 0 in 0.752s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:22 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838 Jun 11 05:25:22 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:23 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2842ae5b-9739-467a-96f9-8777ea245838" returned: 0 in 0.673s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Lock "cinder-quobyte-2842ae5b-9739-467a-96f9-8777ea245838" released by "delete_volume" :: held 1.482s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:25:23 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Created reservations ['ed458a88-14c0-4120-a1e0-1c454a838cc6', 'da71ef39-5c86-4aea-98b0-70d6faeef109', '62d370d7-e545-4363-86cc-efb3e8507c2a', '0d291a19-65c8-45d0-a659-f015444244d3'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:25:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:25:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:25:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:25:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:25:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:25:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:23 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:25:23 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:24 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.631s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:24 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:25:24 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Deleted volume successfully. Jun 11 05:25:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0c760432-82c5-4c7c-8002-ff53a8dc3693 tempest-VolumesCloneTest-990657326 None] Lock "cinder-2842ae5b-9739-467a-96f9-8777ea245838-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Flow 'volume_create_manager' (839e8e70-5b94-40f0-ab65-3d9ce31f599d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b273af-dfd2-4b88-a282-cae63e619f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b273af-dfd2-4b88-a282-cae63e619f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1079982819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b508647-b5e4-49de-ab6f-357ba9c19600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54dcc275f2084d71ac6a36e311d3b6e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:25:29Z,use_quota=True,user_id='71d0abe3b0c3431298ef9b2d9b0ec8d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06aef200-4087-4c12-a75c-1774d8e838bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06aef200-4087-4c12-a75c-1774d8e838bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce8e4c0-22ca-46e1-b38d-f30a268c21dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce8e4c0-22ca-46e1-b38d-f30a268c21dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b508647-b5e4-49de-ab6f-357ba9c19600', 'volume_name': 'volume-6b508647-b5e4-49de-ab6f-357ba9c19600', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c50cb1-1459-4579-a472-471c1ca50309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c50cb1-1459-4579-a472-471c1ca50309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1b4066-6de5-4ce4-8ca1-42efd5bf9cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:25:28 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Volume 6b508647-b5e4-49de-ab6f-357ba9c19600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b508647-b5e4-49de-ab6f-357ba9c19600', 'volume_size': 1} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1079982819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b508647-b5e4-49de-ab6f-357ba9c19600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54dcc275f2084d71ac6a36e311d3b6e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:25:29Z,use_quota=True,user_id='71d0abe3b0c3431298ef9b2d9b0ec8d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Creating volume 6b508647-b5e4-49de-ab6f-357ba9c19600 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:25:28 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:25:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b508647-b5e4-49de-ab6f-357ba9c19600 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:28 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b508647-b5e4-49de-ab6f-357ba9c19600 1073741824 Jun 11 05:25:28 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:29 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b508647-b5e4-49de-ab6f-357ba9c19600 1073741824" returned: 0 in 0.759s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b508647-b5e4-49de-ab6f-357ba9c19600 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:29 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b508647-b5e4-49de-ab6f-357ba9c19600 Jun 11 05:25:29 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:30 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b508647-b5e4-49de-ab6f-357ba9c19600" returned: 0 in 0.580s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1b4066-6de5-4ce4-8ca1-42efd5bf9cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b508647-b5e4-49de-ab6f-357ba9c19600', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a6656c-3f98-4286-b82b-92a584e9679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:25:30 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Volume volume-6b508647-b5e4-49de-ab6f-357ba9c19600 (6b508647-b5e4-49de-ab6f-357ba9c19600): created successfully Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a6656c-3f98-4286-b82b-92a584e9679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Flow 'volume_create_manager' (839e8e70-5b94-40f0-ab65-3d9ce31f599d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:25:30 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9e655940-9196-42c7-b3cc-3cddfcefac28 tempest-VolumesNegativeTest-216999713 None] Created volume successfully. Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:30 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:25:30 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:30 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.613s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:25:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:25:37 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-1e146da3-dd9e-4ef3-a22a-c6c03875c5d0 req-19416927-93a8-444e-8526-1f50a801f28d tempest-TestMinimumBasicScenario-114295726 None] Terminate volume connection completed successfully. Jun 11 05:25:37 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-1e146da3-dd9e-4ef3-a22a-c6c03875c5d0 req-19416927-93a8-444e-8526-1f50a801f28d tempest-TestMinimumBasicScenario-114295726 None] Deleting attachment 22e7d04b-04fe-4898-9b8a-271860a3f105. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:25:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Acquiring lock "cinder-5e8e600e-618c-47ec-943b-7334f9afe22e-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:25:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Lock "cinder-5e8e600e-618c-47ec-943b-7334f9afe22e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:25:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Acquiring lock "cinder-quobyte-5e8e600e-618c-47ec-943b-7334f9afe22e" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:25:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Lock "cinder-quobyte-5e8e600e-618c-47ec-943b-7334f9afe22e" acquired by "delete_volume" :: waited 0.029s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:25:39 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb68529-26c0-46f4-8f7b-8af43e1e17fe]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:25:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:39 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e Jun 11 05:25:39 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:40 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e" returned: 0 in 0.845s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:40 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e Jun 11 05:25:40 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:41 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5e8e600e-618c-47ec-943b-7334f9afe22e" returned: 0 in 0.721s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Lock "cinder-quobyte-5e8e600e-618c-47ec-943b-7334f9afe22e" released by "delete_volume" :: held 1.630s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:25:41 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Created reservations ['a8be9a1b-864a-4f0d-ac28-3e6fa39ff70b', 'e7c68174-a15e-432b-bf82-5ca519d926ab', 'dda81a47-ae40-4548-8a0b-723e464001b8', '00c53d38-a834-476e-b6b5-30f31f36b265'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:25:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:25:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:25:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:25:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:25:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:25:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:41 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:25:41 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:42 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.599s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:42 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:25:42 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Deleted volume successfully. Jun 11 05:25:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7faaee4b-c6b1-40c2-8795-715696f00c23 tempest-TestMinimumBasicScenario-114295726 None] Lock "cinder-5e8e600e-618c-47ec-943b-7334f9afe22e-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:25:42 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-7f6113e3-4cdf-4bea-ac23-6033ad437d6f tempest-TestShelveInstance-526872087 None] Terminate volume connection completed successfully. Jun 11 05:25:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-7f6113e3-4cdf-4bea-ac23-6033ad437d6f tempest-TestShelveInstance-526872087 None] Deleting attachment 8d7b12c9-6568-4957-8f7d-09ec4ca36b29. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:25:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Acquiring lock "cinder-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:25:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Lock "cinder-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:25:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Acquiring lock "cinder-quobyte-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:25:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Lock "cinder-quobyte-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" acquired by "delete_volume" :: waited 0.063s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:25:43 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0bd5bd-8797-424b-a0fb-491c9734031c]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:25:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:43 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b Jun 11 05:25:43 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:44 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" returned: 0 in 1.379s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:44 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b Jun 11 05:25:44 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:45 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" returned: 1 in 0.860s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:25:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:45 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b Jun 11 05:25:45 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:46 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" returned: 0 in 0.656s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:46 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Lock "cinder-quobyte-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b" released by "delete_volume" :: held 3.095s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:25:46 devstack cinder-volume[92308]: DEBUG cinder.quota [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Created reservations ['4759c399-986d-490d-a5e4-34899f56fdf5', '3a697e28-a85e-4682-8e31-17b2c15cd98e', 'cd75013b-e849-4a88-8ecb-7e4af3a56d1e', '6a80f930-d32b-434d-9e6f-467d3fe47ef0'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:25:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:25:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:25:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:25:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:25:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:25:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:25:46 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:25:46 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:25:47 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Jun 11 05:25:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.854s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:25:47 devstack cinder-volume[92308]: DEBUG cinder.manager [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:25:47 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Deleted volume successfully. Jun 11 05:25:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [req-2267e828-9267-43f5-886a-f5c4cd0abb36 req-10b73c52-524b-4f02-aa40-7c37418b39c3 tempest-TestShelveInstance-526872087 None] Lock "cinder-4c7be8c4-69ed-44ba-bda9-637bdebc7e5b-delete_volume" released by "delete_volume" :: held 4.328s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:25:56 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=43,cinder:SELECT=26,cinder:INSERT=9,cinder:DELETE=3 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:25:57 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=34,cinder:SELECT=24,cinder:INSERT=9,cinder:DELETE=3 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Flow 'volume_create_manager' (0d8ef470-b164-42a2-b17e-f77db591ade4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81fc7c7a-4496-438c-bbb1-f26c9ea8f153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81fc7c7a-4496-438c-bbb1-f26c9ea8f153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2067623912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842d99f8-6cdb-451d-9b23-119a64aa0daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e414c83b7d1492993d1cf6b36ac2cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:00Z,use_quota=True,user_id='1877176e277b4033bb0f16824dab7a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4d2ba1-c84d-4fd4-bb47-7589540855fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4d2ba1-c84d-4fd4-bb47-7589540855fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8e47bb-fe8f-464f-a786-97872dc21165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8e47bb-fe8f-464f-a786-97872dc21165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842d99f8-6cdb-451d-9b23-119a64aa0daa', 'volume_name': 'volume-842d99f8-6cdb-451d-9b23-119a64aa0daa', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a22ece9-601d-4717-951c-bed85f1b83af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a22ece9-601d-4717-951c-bed85f1b83af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19936c51-41df-45cc-a526-3c69f75cf47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:00 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Volume 842d99f8-6cdb-451d-9b23-119a64aa0daa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842d99f8-6cdb-451d-9b23-119a64aa0daa', 'volume_size': 1} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2067623912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842d99f8-6cdb-451d-9b23-119a64aa0daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e414c83b7d1492993d1cf6b36ac2cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:00Z,use_quota=True,user_id='1877176e277b4033bb0f16824dab7a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Creating volume 842d99f8-6cdb-451d-9b23-119a64aa0daa {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:26:00 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-842d99f8-6cdb-451d-9b23-119a64aa0daa 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:00 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-842d99f8-6cdb-451d-9b23-119a64aa0daa 1073741824 Jun 11 05:26:00 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Flow 'volume_create_manager' (bcba2e19-a512-452a-8ca4-6c1037bd461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6c7ec6-1ae2-42d4-9ce2-c700eb169808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6c7ec6-1ae2-42d4-9ce2-c700eb169808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2124690677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30d1884-7b7a-4e4c-8002-96046c5963a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e414c83b7d1492993d1cf6b36ac2cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:01Z,use_quota=True,user_id='1877176e277b4033bb0f16824dab7a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f2e523-75af-4468-93a1-61e474edcef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f2e523-75af-4468-93a1-61e474edcef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e9fe4e-904a-43f9-a49c-e607778fa22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e9fe4e-904a-43f9-a49c-e607778fa22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f30d1884-7b7a-4e4c-8002-96046c5963a2', 'volume_name': 'volume-f30d1884-7b7a-4e4c-8002-96046c5963a2', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f832e7f-f3ae-4305-8c66-7f8f1a0032d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f832e7f-f3ae-4305-8c66-7f8f1a0032d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c9971b-1caf-4d14-83ed-4ce4409f96bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Volume f30d1884-7b7a-4e4c-8002-96046c5963a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f30d1884-7b7a-4e4c-8002-96046c5963a2', 'volume_size': 1} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Flow 'volume_create_manager' (e5322480-0abd-470c-b98f-82b54ce9154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c915bc-cfb8-43f2-b76f-7954746b3596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c915bc-cfb8-43f2-b76f-7954746b3596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1609191625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ed9217-daa5-4b68-ab15-71e032ba7560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e414c83b7d1492993d1cf6b36ac2cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:01Z,use_quota=True,user_id='1877176e277b4033bb0f16824dab7a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b27795-4707-4eb0-b8e8-0b1578162e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b27795-4707-4eb0-b8e8-0b1578162e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8c9134-8b35-4477-98d5-84db35a60fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8c9134-8b35-4477-98d5-84db35a60fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06ed9217-daa5-4b68-ab15-71e032ba7560', 'volume_name': 'volume-06ed9217-daa5-4b68-ab15-71e032ba7560', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d208cc-a859-403a-9202-7795e308634a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d208cc-a859-403a-9202-7795e308634a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af13c7f5-631f-4bd3-b530-b81e15efda82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Volume 06ed9217-daa5-4b68-ab15-71e032ba7560: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06ed9217-daa5-4b68-ab15-71e032ba7560', 'volume_size': 1} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Flow 'volume_create_manager' (633a9252-8dd2-4f61-986e-f2c2a424905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5351ea6c-4683-49bd-9f1b-9e9b4edbb431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5351ea6c-4683-49bd-9f1b-9e9b4edbb431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-767788021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e414c83b7d1492993d1cf6b36ac2cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:02Z,use_quota=True,user_id='1877176e277b4033bb0f16824dab7a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55d231c-97bc-450e-ba1c-ce68f03fc204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55d231c-97bc-450e-ba1c-ce68f03fc204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59d6c80-ebec-4df6-af4c-8ac29018565a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59d6c80-ebec-4df6-af4c-8ac29018565a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4', 'volume_name': 'volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88809669-a0f8-4c7a-b559-1c352080f9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88809669-a0f8-4c7a-b559-1c352080f9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50ca72a-6bab-4d4c-ad3c-68607f5b7b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:01 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Volume ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4', 'volume_size': 1} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:01 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-842d99f8-6cdb-451d-9b23-119a64aa0daa 1073741824" returned: 0 in 1.275s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-842d99f8-6cdb-451d-9b23-119a64aa0daa {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:01 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-842d99f8-6cdb-451d-9b23-119a64aa0daa Jun 11 05:26:01 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Flow 'volume_create_manager' (25ba2dfc-4a0c-49c4-afe3-b9d60040fdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f3a586-a1f8-435a-97f4-4b2bb80eb6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f3a586-a1f8-435a-97f4-4b2bb80eb6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-636312561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ab13c9-98c8-49f2-88a1-e189490b0920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e414c83b7d1492993d1cf6b36ac2cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:02Z,use_quota=True,user_id='1877176e277b4033bb0f16824dab7a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b27a81c-d293-4164-8ecf-58e900c400fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b27a81c-d293-4164-8ecf-58e900c400fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f626cc-d5cf-4f89-bc35-35d950be2161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f626cc-d5cf-4f89-bc35-35d950be2161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ab13c9-98c8-49f2-88a1-e189490b0920', 'volume_name': 'volume-94ab13c9-98c8-49f2-88a1-e189490b0920', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2378bb37-2b85-4464-bc75-f31905d5bc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2378bb37-2b85-4464-bc75-f31905d5bc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44323e6c-e9dc-43e2-9489-a244395915ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:02 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Volume 94ab13c9-98c8-49f2-88a1-e189490b0920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ab13c9-98c8-49f2-88a1-e189490b0920', 'volume_size': 1} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:02 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-842d99f8-6cdb-451d-9b23-119a64aa0daa" returned: 0 in 0.805s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.128s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.664s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2124690677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30d1884-7b7a-4e4c-8002-96046c5963a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e414c83b7d1492993d1cf6b36ac2cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:01Z,use_quota=True,user_id='1877176e277b4033bb0f16824dab7a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Creating volume f30d1884-7b7a-4e4c-8002-96046c5963a2 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:26:02 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f30d1884-7b7a-4e4c-8002-96046c5963a2 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19936c51-41df-45cc-a526-3c69f75cf47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842d99f8-6cdb-451d-9b23-119a64aa0daa', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0b5b4e-4128-40ca-b9fe-2eb870e6c4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:02 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f30d1884-7b7a-4e4c-8002-96046c5963a2 1073741824 Jun 11 05:26:02 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:02 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Volume volume-842d99f8-6cdb-451d-9b23-119a64aa0daa (842d99f8-6cdb-451d-9b23-119a64aa0daa): created successfully Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0b5b4e-4128-40ca-b9fe-2eb870e6c4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Flow 'volume_create_manager' (0d8ef470-b164-42a2-b17e-f77db591ade4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:02 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-860ea216-e255-42eb-8d4d-af17b044846f tempest-CreateVolumesFromImageTest-1516048923 None] Created volume successfully. Jun 11 05:26:03 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f30d1884-7b7a-4e4c-8002-96046c5963a2 1073741824" returned: 0 in 0.982s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f30d1884-7b7a-4e4c-8002-96046c5963a2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:03 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f30d1884-7b7a-4e4c-8002-96046c5963a2 Jun 11 05:26:03 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Acquiring lock "cinder-6b508647-b5e4-49de-ab6f-357ba9c19600-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Lock "cinder-6b508647-b5e4-49de-ab6f-357ba9c19600-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Acquiring lock "cinder-quobyte-6b508647-b5e4-49de-ab6f-357ba9c19600" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Lock "cinder-quobyte-6b508647-b5e4-49de-ab6f-357ba9c19600" acquired by "delete_volume" :: waited 0.013s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7957fa72-1f81-405c-9896-56e0d49a24ec]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b508647-b5e4-49de-ab6f-357ba9c19600 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:04 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f30d1884-7b7a-4e4c-8002-96046c5963a2" returned: 0 in 0.733s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.018s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1609191625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ed9217-daa5-4b68-ab15-71e032ba7560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e414c83b7d1492993d1cf6b36ac2cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:01Z,use_quota=True,user_id='1877176e277b4033bb0f16824dab7a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Creating volume 06ed9217-daa5-4b68-ab15-71e032ba7560 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:26:04 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-06ed9217-daa5-4b68-ab15-71e032ba7560 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:04 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b508647-b5e4-49de-ab6f-357ba9c19600 Jun 11 05:26:04 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:04 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-06ed9217-daa5-4b68-ab15-71e032ba7560 1073741824 Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c9971b-1caf-4d14-83ed-4ce4409f96bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f30d1884-7b7a-4e4c-8002-96046c5963a2', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:04 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd07144-432b-4fd2-b95f-8e613f47c66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:04 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Volume volume-f30d1884-7b7a-4e4c-8002-96046c5963a2 (f30d1884-7b7a-4e4c-8002-96046c5963a2): created successfully Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd07144-432b-4fd2-b95f-8e613f47c66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Flow 'volume_create_manager' (bcba2e19-a512-452a-8ca4-6c1037bd461e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:04 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-408609b4-4c66-4d4c-9587-04519e463e2f tempest-CreateVolumesFromImageTest-1516048923 None] Created volume successfully. Jun 11 05:26:05 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b508647-b5e4-49de-ab6f-357ba9c19600" returned: 0 in 0.762s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b508647-b5e4-49de-ab6f-357ba9c19600 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:05 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b508647-b5e4-49de-ab6f-357ba9c19600 Jun 11 05:26:05 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:05 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-06ed9217-daa5-4b68-ab15-71e032ba7560 1073741824" returned: 0 in 0.857s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-06ed9217-daa5-4b68-ab15-71e032ba7560 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:05 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-06ed9217-daa5-4b68-ab15-71e032ba7560 Jun 11 05:26:05 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:05 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b508647-b5e4-49de-ab6f-357ba9c19600" returned: 0 in 0.679s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Lock "cinder-quobyte-6b508647-b5e4-49de-ab6f-357ba9c19600" released by "delete_volume" :: held 1.511s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:05 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Created reservations ['bc483c3c-e88a-4ae3-ab02-8b713cb985c7', '39f31330-f019-46e4-9c25-bccd7881400a', '2fb4a5d7-4cee-493e-a2b9-b1ddf469eed7', '48c90b34-221a-49a5-b582-07d49db5894f'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:06 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:26:06 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:06 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-06ed9217-daa5-4b68-ab15-71e032ba7560" returned: 0 in 0.664s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.211s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-767788021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e414c83b7d1492993d1cf6b36ac2cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:02Z,use_quota=True,user_id='1877176e277b4033bb0f16824dab7a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Creating volume ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:26:06 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:06 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4 1073741824 Jun 11 05:26:06 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af13c7f5-631f-4bd3-b530-b81e15efda82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06ed9217-daa5-4b68-ab15-71e032ba7560', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc92f014-fa98-4931-89eb-bece327f8dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:06 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Volume volume-06ed9217-daa5-4b68-ab15-71e032ba7560 (06ed9217-daa5-4b68-ab15-71e032ba7560): created successfully Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc92f014-fa98-4931-89eb-bece327f8dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Flow 'volume_create_manager' (e5322480-0abd-470c-b98f-82b54ce9154b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:06 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-94da3f3d-6b78-4b50-b7c5-7b1b23800a3f tempest-CreateVolumesFromImageTest-1516048923 None] Created volume successfully. Jun 11 05:26:06 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.650s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:26:06 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Deleted volume successfully. Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e0dec1ee-56c3-45d3-8f8a-1d9932b11199 tempest-VolumesNegativeTest-216999713 None] Lock "cinder-6b508647-b5e4-49de-ab6f-357ba9c19600-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:06 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4 1073741824" returned: 0 in 0.848s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:07 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4 Jun 11 05:26:07 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:07 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4" returned: 0 in 0.713s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.359s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-636312561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ab13c9-98c8-49f2-88a1-e189490b0920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e414c83b7d1492993d1cf6b36ac2cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:02Z,use_quota=True,user_id='1877176e277b4033bb0f16824dab7a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Creating volume 94ab13c9-98c8-49f2-88a1-e189490b0920 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:26:07 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-94ab13c9-98c8-49f2-88a1-e189490b0920 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50ca72a-6bab-4d4c-ad3c-68607f5b7b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386c73ec-a844-4d53-b6da-32425c1ac34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:07 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-94ab13c9-98c8-49f2-88a1-e189490b0920 1073741824 Jun 11 05:26:07 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:07 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Volume volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4 (ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4): created successfully Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386c73ec-a844-4d53-b6da-32425c1ac34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:07 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Flow 'volume_create_manager' (633a9252-8dd2-4f61-986e-f2c2a424905b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:07 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a8694410-68c4-4554-bb2f-7a1f21c77080 tempest-CreateVolumesFromImageTest-1516048923 None] Created volume successfully. Jun 11 05:26:08 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-94ab13c9-98c8-49f2-88a1-e189490b0920 1073741824" returned: 0 in 0.964s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-94ab13c9-98c8-49f2-88a1-e189490b0920 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:08 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-94ab13c9-98c8-49f2-88a1-e189490b0920 Jun 11 05:26:08 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:09 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-94ab13c9-98c8-49f2-88a1-e189490b0920" returned: 0 in 0.807s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44323e6c-e9dc-43e2-9489-a244395915ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ab13c9-98c8-49f2-88a1-e189490b0920', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9dd275-34ef-4028-9bdd-d4b2eda21aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:09 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Volume volume-94ab13c9-98c8-49f2-88a1-e189490b0920 (94ab13c9-98c8-49f2-88a1-e189490b0920): created successfully Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9dd275-34ef-4028-9bdd-d4b2eda21aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Flow 'volume_create_manager' (25ba2dfc-4a0c-49c4-afe3-b9d60040fdce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:09 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-14ffe294-3903-4f51-b932-030e98204bbd tempest-CreateVolumesFromImageTest-1516048923 None] Created volume successfully. Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Flow 'volume_create_manager' (b7a3aa05-8029-4ceb-a069-b52024047467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8156d4-ceb0-4a18-83c6-172c75436d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8156d4-ceb0-4a18-83c6-172c75436d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-25221835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945f9ae7-7d81-46ab-be9d-dd34e846a7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48890de2076542dd8f5619faea80aa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:10Z,use_quota=True,user_id='42b055848e3d41a6afc6139c7dd98864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e54c354-a97d-46b8-8aa4-949b332fdfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e54c354-a97d-46b8-8aa4-949b332fdfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9787a84-0aa2-4d15-ba49-5f657e6892d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9787a84-0aa2-4d15-ba49-5f657e6892d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945f9ae7-7d81-46ab-be9d-dd34e846a7ae', 'volume_name': 'volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad401c0e-1f79-4cc6-bbce-e1ea0ec8e577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad401c0e-1f79-4cc6-bbce-e1ea0ec8e577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded9a430-32e6-42f0-a331-5144c37b76a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:09 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Volume 945f9ae7-7d81-46ab-be9d-dd34e846a7ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae', 'volume_size': 1} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-25221835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945f9ae7-7d81-46ab-be9d-dd34e846a7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48890de2076542dd8f5619faea80aa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:10Z,use_quota=True,user_id='42b055848e3d41a6afc6139c7dd98864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Creating volume 945f9ae7-7d81-46ab-be9d-dd34e846a7ae {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:26:09 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:26:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:10 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae 1073741824 Jun 11 05:26:10 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "cinder-94ab13c9-98c8-49f2-88a1-e189490b0920-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-94ab13c9-98c8-49f2-88a1-e189490b0920-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "cinder-quobyte-94ab13c9-98c8-49f2-88a1-e189490b0920" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-quobyte-94ab13c9-98c8-49f2-88a1-e189490b0920" acquired by "delete_volume" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:10 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac465e58-6bce-4321-a36e-349106f2278d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-94ab13c9-98c8-49f2-88a1-e189490b0920 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:10 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-94ab13c9-98c8-49f2-88a1-e189490b0920 Jun 11 05:26:10 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:10 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae 1073741824" returned: 0 in 0.929s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:10 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae Jun 11 05:26:10 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:11 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-94ab13c9-98c8-49f2-88a1-e189490b0920" returned: 0 in 0.838s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-94ab13c9-98c8-49f2-88a1-e189490b0920 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:11 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-94ab13c9-98c8-49f2-88a1-e189490b0920 Jun 11 05:26:11 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:11 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" returned: 0 in 0.722s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:26:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded9a430-32e6-42f0-a331-5144c37b76a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280a2e62-f320-4aab-b236-6ef184989598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:11 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Volume volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae (945f9ae7-7d81-46ab-be9d-dd34e846a7ae): created successfully Jun 11 05:26:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280a2e62-f320-4aab-b236-6ef184989598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:11 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Flow 'volume_create_manager' (b7a3aa05-8029-4ceb-a069-b52024047467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:11 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e8de233a-a3f6-4701-96ae-80b69b68402d tempest-VolumesSnapshotListTestJSON-1378144178 None] Created volume successfully. Jun 11 05:26:12 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-94ab13c9-98c8-49f2-88a1-e189490b0920" returned: 0 in 0.764s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-quobyte-94ab13c9-98c8-49f2-88a1-e189490b0920" released by "delete_volume" :: held 1.651s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Created reservations ['87c62a44-5570-412c-b99d-5a80ad021194', 'c90acad7-ae84-4d10-a927-fbb76ecc6670', '2980d007-ead5-43a4-97e6-28ca8470c989', '26c84bb4-541a-444b-87b1-9b7818c6e3d6'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:12 devstack sudo[109089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:26:12 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] Creating offline snapshot d7231faa-20b2-45b9-a119-2c9d9ae1c84f of volume 945f9ae7-7d81-46ab-be9d-dd34e846a7ae {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e2d91a-1955-4e6e-938e-75b881cd78b7]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:12 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae Jun 11 05:26:12 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "cinder-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "cinder-quobyte-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-quobyte-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc87b64-8cbf-48fb-8649-3ad3664e1c42]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:12 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4 Jun 11 05:26:12 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:12 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.742s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:26:12 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Deleted volume successfully. Jun 11 05:26:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4401efd6-8d7a-4926-b4a5-be1f99dd6718 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-94ab13c9-98c8-49f2-88a1-e189490b0920-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:13 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" returned: 0 in 0.867s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:13 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f 1G Jun 11 05:26:13 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:13 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4" returned: 0 in 0.847s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:13 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4 Jun 11 05:26:13 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:14 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f 1G" returned: 0 in 0.854s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:14 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f Jun 11 05:26:14 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:14 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4" returned: 0 in 0.679s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-quobyte-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4" released by "delete_volume" :: held 1.588s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Created reservations ['91784108-926d-4a7f-994b-05e85ece63b4', '8cd1b542-0c33-4a70-89c4-dd255d8edebb', 'd1d6b744-3edf-4080-aeb1-508b148538bb', '162d03ed-2ec6-4659-a421-0fbdef80b644'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:14 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:26:14 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:14 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f" returned: 0 in 0.710s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:14 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f is being set with open permissions: ugo+rw Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:14 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f Jun 11 05:26:14 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "cinder-06ed9217-daa5-4b68-ab15-71e032ba7560-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-06ed9217-daa5-4b68-ab15-71e032ba7560-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "cinder-quobyte-06ed9217-daa5-4b68-ab15-71e032ba7560" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-quobyte-06ed9217-daa5-4b68-ab15-71e032ba7560" acquired by "delete_volume" :: waited 0.024s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:15 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d28083-9d13-4653-9dc5-f369db55cd49]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-06ed9217-daa5-4b68-ab15-71e032ba7560 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:15 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.740s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:15 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:26:15 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Deleted volume successfully. Jun 11 05:26:15 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-06ed9217-daa5-4b68-ab15-71e032ba7560 Jun 11 05:26:15 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-bcbdb436-d55f-4fd6-81cd-6a34d9f4d3ac tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-ac63d7c4-a03e-4f7a-8c1d-924ac7a30cb4-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:15 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f" returned: 0 in 0.742s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:15 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.info Jun 11 05:26:15 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:15 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-06ed9217-daa5-4b68-ab15-71e032ba7560" returned: 0 in 0.783s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-06ed9217-daa5-4b68-ab15-71e032ba7560 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:15 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-06ed9217-daa5-4b68-ab15-71e032ba7560 Jun 11 05:26:15 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:16 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.info" returned: 0 in 0.757s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:16 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.info is being set with open permissions: ugo+rw Jun 11 05:26:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:16 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.info Jun 11 05:26:16 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:16 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-06ed9217-daa5-4b68-ab15-71e032ba7560" returned: 0 in 0.697s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-quobyte-06ed9217-daa5-4b68-ab15-71e032ba7560" released by "delete_volume" :: held 1.543s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:16 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Created reservations ['ecbb2c93-e5ee-4aa5-a5d0-cb618d1e9b87', '3b20a350-1f64-428f-8021-9c6d7d469509', '64c76e52-d880-471b-af9d-8896358a0af0', '91587eb5-5a39-4515-94b3-44c2306f90c6'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:26:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:16 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:16 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:16 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:26:16 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:16 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.info" returned: 0 in 0.655s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.687s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:16 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f38b45f9-1ee5-4781-ad67-203b88712cfc tempest-VolumesSnapshotListTestJSON-1378144178 None] Create snapshot completed successfully Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "cinder-f30d1884-7b7a-4e4c-8002-96046c5963a2-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-f30d1884-7b7a-4e4c-8002-96046c5963a2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "cinder-quobyte-f30d1884-7b7a-4e4c-8002-96046c5963a2" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-quobyte-f30d1884-7b7a-4e4c-8002-96046c5963a2" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:17 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.677s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:26:17 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Deleted volume successfully. Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7520b625-3923-411f-9587-41e5b2b92a5c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f30d1884-7b7a-4e4c-8002-96046c5963a2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-501f39c1-aad5-4bd9-b123-f13ca353c9e2 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-06ed9217-daa5-4b68-ab15-71e032ba7560-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:17 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f30d1884-7b7a-4e4c-8002-96046c5963a2 Jun 11 05:26:17 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] Creating offline snapshot aa342f88-f5e5-4c43-868e-0531b3565bac of volume 945f9ae7-7d81-46ab-be9d-dd34e846a7ae {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ad5d04-28be-4eaa-a703-9e603cf5ab4d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:18 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f Jun 11 05:26:18 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:18 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f30d1884-7b7a-4e4c-8002-96046c5963a2" returned: 0 in 1.025s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f30d1884-7b7a-4e4c-8002-96046c5963a2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:18 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f30d1884-7b7a-4e4c-8002-96046c5963a2 Jun 11 05:26:18 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:18 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f" returned: 0 in 0.817s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:26:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:18 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac 1G Jun 11 05:26:18 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:18 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f30d1884-7b7a-4e4c-8002-96046c5963a2" returned: 0 in 0.647s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-quobyte-f30d1884-7b7a-4e4c-8002-96046c5963a2" released by "delete_volume" :: held 1.727s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Created reservations ['f9cc10c0-6488-4560-984f-984f30d7e627', '00db5a4b-cbe7-4d82-a82b-542f3a9df32c', '25fa20ff-bb9a-4891-bfb3-d5d02f11e43b', '48d54265-cd94-4e34-b34d-db06b94a9bbb'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:19 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:26:19 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "cinder-842d99f8-6cdb-451d-9b23-119a64aa0daa-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-842d99f8-6cdb-451d-9b23-119a64aa0daa-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "cinder-quobyte-842d99f8-6cdb-451d-9b23-119a64aa0daa" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-quobyte-842d99f8-6cdb-451d-9b23-119a64aa0daa" acquired by "delete_volume" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bad95b2-2d19-41e9-a854-a4b6865819d1]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-842d99f8-6cdb-451d-9b23-119a64aa0daa {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:19 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac 1G" returned: 0 in 0.990s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:19 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-842d99f8-6cdb-451d-9b23-119a64aa0daa Jun 11 05:26:19 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:19 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac Jun 11 05:26:19 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:19 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.710s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:26:19 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Deleted volume successfully. Jun 11 05:26:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-25a497f1-fded-41dc-aa6f-f8f8930ba589 tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-f30d1884-7b7a-4e4c-8002-96046c5963a2-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:20 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-842d99f8-6cdb-451d-9b23-119a64aa0daa" returned: 0 in 0.890s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-842d99f8-6cdb-451d-9b23-119a64aa0daa {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:20 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac" returned: 0 in 0.753s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:20 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac is being set with open permissions: ugo+rw Jun 11 05:26:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:20 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-842d99f8-6cdb-451d-9b23-119a64aa0daa Jun 11 05:26:20 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:20 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac Jun 11 05:26:20 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:21 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-842d99f8-6cdb-451d-9b23-119a64aa0daa" returned: 0 in 0.645s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-quobyte-842d99f8-6cdb-451d-9b23-119a64aa0daa" released by "delete_volume" :: held 1.592s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:21 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac" returned: 0 in 0.663s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.366s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:21 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b8cb02e7-7b7f-4156-8841-47a4d7196b2e tempest-VolumesSnapshotListTestJSON-1378144178 None] Create snapshot completed successfully Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Created reservations ['63fdf7b0-61a4-4818-acf3-08eb8bff486d', '8c5caf47-590a-4ba6-8375-0c44871c4e2e', 'a8c04876-4742-49b8-b00d-5461b2e2659d', '1aa5f311-4fd0-4e3a-90ed-76aa36cbeab2'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:21 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:26:21 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:21 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.613s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:26:21 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Deleted volume successfully. Jun 11 05:26:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-17c6a025-07ac-44cf-b345-9aedafbf7f8f tempest-CreateVolumesFromImageTest-1516048923 None] Lock "cinder-842d99f8-6cdb-451d-9b23-119a64aa0daa-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] Creating offline snapshot 0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 of volume 945f9ae7-7d81-46ab-be9d-dd34e846a7ae {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:26:22 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c86d44-2eb0-40e6-8332-191c5b00c795]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:22 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac Jun 11 05:26:22 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:23 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac" returned: 0 in 0.961s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:23 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:26:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:23 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 1G Jun 11 05:26:23 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:26:24 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Flow 'volume_create_manager' (c698788b-bba0-457b-b5a8-2572a453aefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931cd0a4-ecdc-48ef-8695-df3222f42720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 1G" returned: 0 in 0.979s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931cd0a4-ecdc-48ef-8695-df3222f42720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1195977734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850f9143-3f3c-429c-a311-de6f4e0a766b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcb048dad2346689028f64be27f4852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:24Z,use_quota=True,user_id='639b6d7e821240adbabdda94fc3aa755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:24 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 Jun 11 05:26:24 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f34277-96db-474b-bd94-4e7824bf5ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f34277-96db-474b-bd94-4e7824bf5ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1c2389-f2a1-440c-b5a3-70d1e4785070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1c2389-f2a1-440c-b5a3-70d1e4785070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '850f9143-3f3c-429c-a311-de6f4e0a766b', 'volume_name': 'volume-850f9143-3f3c-429c-a311-de6f4e0a766b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7ec20e-4dfc-42df-9394-0695d2d83895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7ec20e-4dfc-42df-9394-0695d2d83895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bae83d-7e71-4f9b-be7c-fa1f7b4051f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:24 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Volume 850f9143-3f3c-429c-a311-de6f4e0a766b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-850f9143-3f3c-429c-a311-de6f4e0a766b', 'volume_size': 1} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Flow 'volume_create_manager' (b6a97c40-97ec-4ec7-a9b7-372e9d4f4c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0398ead0-b66c-4b98-a93c-e4591a61fb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0398ead0-b66c-4b98-a93c-e4591a61fb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-150064263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5cdea5-d262-42a9-9be5-cb2293d0e0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcb048dad2346689028f64be27f4852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:25Z,use_quota=True,user_id='639b6d7e821240adbabdda94fc3aa755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc39146-2ba0-4a99-b39d-1df990ae2104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc39146-2ba0-4a99-b39d-1df990ae2104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb13b69-c4fe-4019-9e64-7fa4599bb542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb13b69-c4fe-4019-9e64-7fa4599bb542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd5cdea5-d262-42a9-9be5-cb2293d0e0c8', 'volume_name': 'volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08a0ee4-18c0-481e-a3ca-8750117344d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08a0ee4-18c0-481e-a3ca-8750117344d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1829abba-7480-427e-84bc-07e43e46dc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:24 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Volume bd5cdea5-d262-42a9-9be5-cb2293d0e0c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8', 'volume_size': 1} Jun 11 05:26:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:25 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1" returned: 0 in 0.761s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:25 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 is being set with open permissions: ugo+rw Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:25 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 Jun 11 05:26:25 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:25 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1" returned: 0 in 0.636s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.460s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.370s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1195977734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850f9143-3f3c-429c-a311-de6f4e0a766b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcb048dad2346689028f64be27f4852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:24Z,use_quota=True,user_id='639b6d7e821240adbabdda94fc3aa755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Creating volume 850f9143-3f3c-429c-a311-de6f4e0a766b {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:26:25 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:26:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:25 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b 1073741824 Jun 11 05:26:25 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:25 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-25d5208e-d207-467b-b153-cb2934916478 tempest-VolumesSnapshotListTestJSON-1378144178 None] Create snapshot completed successfully Jun 11 05:26:26 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b 1073741824" returned: 0 in 0.976s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:26 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b Jun 11 05:26:26 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "cinder-0aad3196-82d1-41bc-bfd5-5a517d8cd8d1-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-0aad3196-82d1-41bc-bfd5-5a517d8cd8d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "cinder-quobyte-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "cinder-quobyte-0aad3196-82d1-41bc-bfd5-5a517d8cd8d1" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:27 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b" returned: 0 in 0.775s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.820s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-150064263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5cdea5-d262-42a9-9be5-cb2293d0e0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcb048dad2346689028f64be27f4852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:25Z,use_quota=True,user_id='639b6d7e821240adbabdda94fc3aa755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Creating volume bd5cdea5-d262-42a9-9be5-cb2293d0e0c8 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:26:27 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-0aad3196-82d1-41bc-bfd5-5a517d8cd8d1" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Deleting offline snapshot 0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 of volume 945f9ae7-7d81-46ab-be9d-dd34e846a7ae {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:26:27 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8 1073741824 Jun 11 05:26:27 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] snapshot_file for this snap is: volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bae83d-7e71-4f9b-be7c-fa1f7b4051f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-850f9143-3f3c-429c-a311-de6f4e0a766b', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ebae8d-2c34-4799-a0ac-17a59c497a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae7508e-9dfb-44af-ba84-8223e3b8229c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:27 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Volume volume-850f9143-3f3c-429c-a311-de6f4e0a766b (850f9143-3f3c-429c-a311-de6f4e0a766b): created successfully Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ebae8d-2c34-4799-a0ac-17a59c497a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Flow 'volume_create_manager' (c698788b-bba0-457b-b5a8-2572a453aefe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:27 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-6d2d073b-680e-4e38-97f1-d03086b0343c tempest-TestServerVolumeAttachmentScenario-152127855 None] Created volume successfully. Jun 11 05:26:27 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 Jun 11 05:26:27 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:28 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1" returned: 0 in 0.890s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5f8d09-37c4-4914-926c-ce0e59d0d33d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:28 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8 1073741824" returned: 0 in 1.166s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:28 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac Jun 11 05:26:28 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Flow 'volume_create_manager' (ea8b3736-18c5-4e65-a658-1becf1d86b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ea2bf2-a7f4-4495-9d87-19ac33faf108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ea2bf2-a7f4-4495-9d87-19ac33faf108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4f97b5-2c31-495e-9a16-d84612caf064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81ac74c0385493185d63b89a9f4bac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:29Z,use_quota=True,user_id='20a36d14b6794d9cae62e7b029c23990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06239082-c3f7-4622-adc3-41de2514b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06239082-c3f7-4622-adc3-41de2514b30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3849bed-7d09-405a-8b23-8b762226d43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG cinder.image.glance [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Creating Keystone auth plugin from conf {{(pid=92308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 11 05:26:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:28 devstack sudo[109267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8 Jun 11 05:26:28 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3849bed-7d09-405a-8b23-8b762226d43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a4f97b5-2c31-495e-9a16-d84612caf064', 'volume_name': 'volume-4a4f97b5-2c31-495e-9a16-d84612caf064', 'volume_size': 1, 'image_id': '611aa24f-c908-44bc-8dc3-b8e97fc24d3f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/611aa24f-c908-44bc-8dc3-b8e97fc24d3f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd71d1abe04a8606d870144ea4fa40fca', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd81ac74c0385493185d63b89a9f4bac1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a5baddf9cebb46cc6b341cee1f0534b8531cb1cb5b231841b66ee372d04fdc6eb624f12e4ab9da5bfd6e893b93f643d7b6af2af2506c5fcaaf1fec0560ae15f6', 'id': '611aa24f-c908-44bc-8dc3-b8e97fc24d3f', 'created_at': datetime.datetime(2026, 6, 11, 3, 26, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 26, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/611aa24f-c908-44bc-8dc3-b8e97fc24d3f/file', 'properties': {}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1799a9a2-195c-4624-80ef-566ba0d7fce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1799a9a2-195c-4624-80ef-566ba0d7fce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1942cd89-cd6e-44a0-9a4b-e4e1aec17074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:29 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Volume 4a4f97b5-2c31-495e-9a16-d84612caf064: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a4f97b5-2c31-495e-9a16-d84612caf064', 'volume_size': 1, 'image_id': '611aa24f-c908-44bc-8dc3-b8e97fc24d3f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/611aa24f-c908-44bc-8dc3-b8e97fc24d3f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd71d1abe04a8606d870144ea4fa40fca', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd81ac74c0385493185d63b89a9f4bac1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a5baddf9cebb46cc6b341cee1f0534b8531cb1cb5b231841b66ee372d04fdc6eb624f12e4ab9da5bfd6e893b93f643d7b6af2af2506c5fcaaf1fec0560ae15f6', 'id': '611aa24f-c908-44bc-8dc3-b8e97fc24d3f', 'created_at': datetime.datetime(2026, 6, 11, 3, 26, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 26, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/611aa24f-c908-44bc-8dc3-b8e97fc24d3f/file', 'properties': {}}, 'image_service': } Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Trying to clone 4a4f97b5-2c31-495e-9a16-d84612caf064 from image 611aa24f-c908-44bc-8dc3-b8e97fc24d3f at location (None, [{'url': 'file:///opt/stack/data/glance/images/611aa24f-c908-44bc-8dc3-b8e97fc24d3f', 'metadata': {}}]). {{(pid=92308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 11 05:26:29 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Image download 0.00 MB at 0.00 MB/s Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeef9cd7-cdd4-4d41-950e-775a61d5bf9b]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:29 devstack sudo[109271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD Jun 11 05:26:29 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:29 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac" returned: 0 in 0.836s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:29 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 Jun 11 05:26:29 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:29 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8" returned: 0 in 0.654s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1829abba-7480-427e-84bc-07e43e46dc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6cf2fa-4276-4da0-ba06-401695bd6d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:29 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Volume volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8 (bd5cdea5-d262-42a9-9be5-cb2293d0e0c8): created successfully Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6cf2fa-4276-4da0-ba06-401695bd6d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Flow 'volume_create_manager' (b6a97c40-97ec-4ec7-a9b7-372e9d4f4c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:29 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-93b99497-5931-4db4-bdc3-1efd898219b4 tempest-TestServerVolumeAttachmentScenario-152127855 None] Created volume successfully. Jun 11 05:26:30 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:30 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD Jun 11 05:26:30 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:30 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1" returned: 0 in 0.827s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:30 devstack sudo[109285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:26:30 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:30 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1 Jun 11 05:26:30 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:30 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD" returned: 1 in 0.698s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Temporary image 611aa24f-c908-44bc-8dc3-b8e97fc24d3f is fetched for user 20a36d14b6794d9cae62e7b029c23990. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[95415ace-7c44-4359-9ccb-0008c2fa4da0]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:30 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.625s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:26:30 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD Jun 11 05:26:30 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:30 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.0aad3196-82d1-41bc-bfd5-5a517d8cd8d1" returned: 0 in 0.663s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-0aad3196-82d1-41bc-bfd5-5a517d8cd8d1" released by "_delete_snapshot" :: held 3.385s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:30 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" released by "delete_snapshot" :: held 3.451s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Created reservations ['b7d03733-e8f3-42ad-843b-21f8600a3c41', 'a5c44cbf-e7fa-4536-b55e-1ea5d1b3c315', '5b88c2c3-c2cb-4cf6-ba64-3e3d5029b97f', '69867dd7-fb27-4b97-b967-4c21bc3f3ff3'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:26:31 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Delete snapshot completed successfully. Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2f8cf196-37b1-41a8-9991-af69464f3573 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-0aad3196-82d1-41bc-bfd5-5a517d8cd8d1-delete_snapshot" released by "delete_snapshot" :: held 3.604s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:31 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD" returned: 0 in 0.692s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:31 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD Jun 11 05:26:31 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "cinder-aa342f88-f5e5-4c43-868e-0531b3565bac-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-aa342f88-f5e5-4c43-868e-0531b3565bac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "cinder-quobyte-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "cinder-quobyte-aa342f88-f5e5-4c43-868e-0531b3565bac" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-aa342f88-f5e5-4c43-868e-0531b3565bac" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Deleting offline snapshot aa342f88-f5e5-4c43-868e-0531b3565bac of volume 945f9ae7-7d81-46ab-be9d-dd34e846a7ae {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] snapshot_file for this snap is: volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4038f635-4443-4dd4-a121-68a350d990ba]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:32 devstack sudo[109300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac Jun 11 05:26:32 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:32 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD" returned: 1 in 0.709s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4f97b5-2c31-495e-9a16-d84612caf064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81ac74c0385493185d63b89a9f4bac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:26:29Z,use_quota=True,user_id='20a36d14b6794d9cae62e7b029c23990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Creating volume 4a4f97b5-2c31-495e-9a16-d84612caf064 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:26:32 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:32 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 1073741824 Jun 11 05:26:32 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:32 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac" returned: 0 in 0.711s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad277c45-7b0c-4af9-915c-a884337d230a]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:32 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f Jun 11 05:26:32 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:33 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 1073741824" returned: 0 in 0.827s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:33 devstack sudo[109316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 Jun 11 05:26:33 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:33 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f" returned: 0 in 0.845s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:26:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:33 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac Jun 11 05:26:33 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:33 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064" returned: 0 in 0.666s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:26:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:33 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Attempting download of 611aa24f-c908-44bc-8dc3-b8e97fc24d3f ((None, [{'url': 'file:///opt/stack/data/glance/images/611aa24f-c908-44bc-8dc3-b8e97fc24d3f', 'metadata': {}}])) to volume 4a4f97b5-2c31-495e-9a16-d84612caf064. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 11 05:26:33 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc20d320-8ca6-4a6a-98ac-3acef2011c94]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_qxpww_gd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:34 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_qxpww_gd Jun 11 05:26:34 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:34 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac" returned: 0 in 0.839s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:34 devstack sudo[109336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac Jun 11 05:26:34 devstack sudo[109336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:34 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_qxpww_gd" returned: 0 in 0.759s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_qxpww_gd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:34 devstack sudo[109341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_qxpww_gd Jun 11 05:26:34 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:34 devstack sudo[109336]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.aa342f88-f5e5-4c43-868e-0531b3565bac" returned: 0 in 0.641s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-aa342f88-f5e5-4c43-868e-0531b3565bac" released by "_delete_snapshot" :: held 3.159s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" released by "delete_snapshot" :: held 3.199s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:35 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Created reservations ['2521c44c-bdea-4b95-8e66-b55afd1c5021', '9681faa3-7534-4b84-aca3-5ab532b3458b', '1f3e20ce-89f6-404b-97d1-3d74621f9e55', '29e0ed00-82bf-44ad-b781-329e724724b0'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:26:35 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Delete snapshot completed successfully. Jun 11 05:26:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-80b83750-579d-46d1-adce-1e8d83a2a492 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-aa342f88-f5e5-4c43-868e-0531b3565bac-delete_snapshot" released by "delete_snapshot" :: held 3.366s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:35 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_qxpww_gd" returned: 1 in 0.716s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_qxpww_gd' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:26:35 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aa6373-3bea-4da3-b3e9-d9eb0faab5ed]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:35 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD Jun 11 05:26:35 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:36 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD" returned: 0 in 0.661s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "cinder-d7231faa-20b2-45b9-a119-2c9d9ae1c84f-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-d7231faa-20b2-45b9-a119-2c9d9ae1c84f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "cinder-quobyte-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "cinder-quobyte-d7231faa-20b2-45b9-a119-2c9d9ae1c84f" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-d7231faa-20b2-45b9-a119-2c9d9ae1c84f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Deleting offline snapshot d7231faa-20b2-45b9-a119-2c9d9ae1c84f of volume 945f9ae7-7d81-46ab-be9d-dd34e846a7ae {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:26:36 devstack sudo[109366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD Jun 11 05:26:36 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] snapshot_file for this snap is: volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e35826b-5d25-47f0-8fea-7fe078f9b8e5]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:36 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f Jun 11 05:26:36 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:36 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD" returned: 1 in 0.681s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] 611aa24f-c908-44bc-8dc3-b8e97fc24d3f was raw, converting to raw {{(pid=92308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:36 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 Jun 11 05:26:36 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:36 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f" returned: 0 in 0.759s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[307ee09a-2c50-4a83-b06b-6f65807da913]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:37 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae Jun 11 05:26:37 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:37 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064" returned: 0 in 0.740s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:37 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_611aa24f-c908-44bc-8dc3-b8e97fc24d3f_s3xrfcshdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:26:37 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Converted 0.00 MB image at 0.00 MB/s Jun 11 05:26:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:37 devstack sudo[109383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 1G Jun 11 05:26:37 devstack sudo[109383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:37 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" returned: 0 in 0.707s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:37 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f Jun 11 05:26:37 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:38 devstack sudo[109383]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 1G" returned: 0 in 0.653s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:38 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[637a24bd-4283-404f-800b-3ff8c9f8cd3c]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:38 devstack sudo[109397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 Jun 11 05:26:38 devstack sudo[109397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:38 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f" returned: 0 in 0.748s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:38 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f Jun 11 05:26:38 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:38 devstack sudo[109397]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064" returned: 0 in 0.731s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:39 devstack sudo[109408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 Jun 11 05:26:39 devstack sudo[109408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:39 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae.d7231faa-20b2-45b9-a119-2c9d9ae1c84f" returned: 0 in 0.605s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-d7231faa-20b2-45b9-a119-2c9d9ae1c84f" released by "_delete_snapshot" :: held 2.949s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" released by "delete_snapshot" :: held 2.976s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Created reservations ['a35853ea-d07c-4f5d-8583-ee8465244ccd', '3709946f-63ac-47da-b350-f05779a1771a', 'f4875aa7-2f7e-4bf3-9d1c-70c7360a0005', '792880f9-95b6-4ac5-aabc-e4468327bca9'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:26:39 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Delete snapshot completed successfully. Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f248f6da-8b75-4f55-bad4-b919eda9fccf tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-d7231faa-20b2-45b9-a119-2c9d9ae1c84f-delete_snapshot" released by "delete_snapshot" :: held 3.113s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "cinder-945f9ae7-7d81-46ab-be9d-dd34e846a7ae-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-945f9ae7-7d81-46ab-be9d-dd34e846a7ae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "cinder-quobyte-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" acquired by "delete_volume" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cc6918-d100-4d0a-8c22-ddf3628ca986]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:39 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae Jun 11 05:26:39 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:39 devstack sudo[109408]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064" returned: 1 in 0.832s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Downloaded image 611aa24f-c908-44bc-8dc3-b8e97fc24d3f ((None, [{'url': 'file:///opt/stack/data/glance/images/611aa24f-c908-44bc-8dc3-b8e97fc24d3f', 'metadata': {}}])) to volume 4a4f97b5-2c31-495e-9a16-d84612caf064 successfully. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Temporary image 611aa24f-c908-44bc-8dc3-b8e97fc24d3f for user 20a36d14b6794d9cae62e7b029c23990 is deleted. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Marking volume 4a4f97b5-2c31-495e-9a16-d84612caf064 as bootable. {{(pid=92308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Copying metadata from image 611aa24f-c908-44bc-8dc3-b8e97fc24d3f to 4a4f97b5-2c31-495e-9a16-d84612caf064. {{(pid=92308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Creating volume glance metadata for volume 4a4f97b5-2c31-495e-9a16-d84612caf064 backed by image 611aa24f-c908-44bc-8dc3-b8e97fc24d3f with: {'image_id': '611aa24f-c908-44bc-8dc3-b8e97fc24d3f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd71d1abe04a8606d870144ea4fa40fca', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1942cd89-cd6e-44a0-9a4b-e4e1aec17074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4f97b5-2c31-495e-9a16-d84612caf064', 'volume_size': 1, 'image_id': '611aa24f-c908-44bc-8dc3-b8e97fc24d3f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/611aa24f-c908-44bc-8dc3-b8e97fc24d3f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd71d1abe04a8606d870144ea4fa40fca', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd81ac74c0385493185d63b89a9f4bac1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a5baddf9cebb46cc6b341cee1f0534b8531cb1cb5b231841b66ee372d04fdc6eb624f12e4ab9da5bfd6e893b93f643d7b6af2af2506c5fcaaf1fec0560ae15f6', 'id': '611aa24f-c908-44bc-8dc3-b8e97fc24d3f', 'created_at': datetime.datetime(2026, 6, 11, 3, 26, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 26, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/611aa24f-c908-44bc-8dc3-b8e97fc24d3f/file', 'properties': {}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d5b6ca-0ae0-4c07-aa37-456c4e3a4b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:26:39 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Volume volume-4a4f97b5-2c31-495e-9a16-d84612caf064 (4a4f97b5-2c31-495e-9a16-d84612caf064): created successfully Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d5b6ca-0ae0-4c07-aa37-456c4e3a4b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:26:39 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Flow 'volume_create_manager' (ea8b3736-18c5-4e65-a658-1becf1d86b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:26:39 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-826a71f3-1f0e-4113-ab56-ca4ebd9962a7 tempest-VolumeImageDependencyTests-2143406761 None] Created volume successfully. Jun 11 05:26:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Acquiring lock "cinder-4a4f97b5-2c31-495e-9a16-d84612caf064-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Lock "cinder-4a4f97b5-2c31-495e-9a16-d84612caf064-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:40 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" returned: 0 in 1.197s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Acquiring lock "cinder-quobyte-4a4f97b5-2c31-495e-9a16-d84612caf064" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:26:40 devstack sudo[109481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae Jun 11 05:26:40 devstack sudo[109481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Lock "cinder-quobyte-4a4f97b5-2c31-495e-9a16-d84612caf064" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:26:40 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b27a130-c3ae-4a8a-aab1-467d4fbc648b]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:26:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:40 devstack sudo[109483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 Jun 11 05:26:40 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:41 devstack sudo[109481]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" returned: 0 in 0.636s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-quobyte-945f9ae7-7d81-46ab-be9d-dd34e846a7ae" released by "delete_volume" :: held 1.910s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:41 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Created reservations ['19275a66-1ab8-4b20-bf0a-c679b1af7feb', '8e350513-f298-4d7e-beb8-20a6f43c51b2', '96d2c945-986b-4af8-9122-c8543ccd4b52', '564fbe38-dbe2-467c-91f5-acd2126d016b'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:26:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:41 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:26:41 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:41 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064" returned: 0 in 0.836s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:41 devstack sudo[109491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 Jun 11 05:26:41 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:42 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.040s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:42 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:26:42 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Deleted volume successfully. Jun 11 05:26:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1b86093b-5fb8-49a2-8454-15ebdc527356 tempest-VolumesSnapshotListTestJSON-1378144178 None] Lock "cinder-945f9ae7-7d81-46ab-be9d-dd34e846a7ae-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:42 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064" returned: 1 in 1.102s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:26:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:42 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064 Jun 11 05:26:42 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:43 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-4a4f97b5-2c31-495e-9a16-d84612caf064" returned: 0 in 0.753s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Lock "cinder-quobyte-4a4f97b5-2c31-495e-9a16-d84612caf064" released by "delete_volume" :: held 2.787s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:43 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Created reservations ['a9e5c3c1-8a75-48eb-ba3c-5dee719ac4ae', '251a4ed5-4b0f-4a42-a0a7-b9bcffc26c41', '199e65c6-7259-49c5-b477-4b0fff56f804', '4a5c7352-cf60-41f2-b624-effcbca9f702'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:26:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:26:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:26:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:26:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:26:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:26:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:26:43 devstack sudo[109500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:26:43 devstack sudo[109500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:26:44 devstack sudo[109500]: pam_unix(sudo:session): session closed for user root Jun 11 05:26:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.833s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:26:44 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:26:44 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Deleted volume successfully. Jun 11 05:26:44 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c167e815-792e-4335-96e7-1ee1290ed430 tempest-VolumeImageDependencyTests-2143406761 None] Lock "cinder-4a4f97b5-2c31-495e-9a16-d84612caf064-delete_volume" released by "delete_volume" :: held 3.917s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:26:53 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=94,cinder:UPDATE=120,cinder:INSERT=34,cinder:DELETE=11 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:26:54 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=80,cinder:UPDATE=106,cinder:INSERT=29,cinder:DELETE=9 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:27:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-bc881585-9712-4614-a909-86ea8ce54e02 req-d7424046-89ac-4fd8-bfa3-da564b8d0acb tempest-TestServerVolumeAttachmentScenario-152127855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-bc881585-9712-4614-a909-86ea8ce54e02 req-d7424046-89ac-4fd8-bfa3-da564b8d0acb tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:08 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cccfae6-4f6a-4ded-82eb-e92f657a169d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:27:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-bc881585-9712-4614-a909-86ea8ce54e02 req-d7424046-89ac-4fd8-bfa3-da564b8d0acb tempest-TestServerVolumeAttachmentScenario-152127855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:08 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b Jun 11 05:27:08 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:09 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-bc881585-9712-4614-a909-86ea8ce54e02 req-d7424046-89ac-4fd8-bfa3-da564b8d0acb tempest-TestServerVolumeAttachmentScenario-152127855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b" returned: 0 in 0.736s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-bc881585-9712-4614-a909-86ea8ce54e02 req-d7424046-89ac-4fd8-bfa3-da564b8d0acb tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.758s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-bc881585-9712-4614-a909-86ea8ce54e02 req-d7424046-89ac-4fd8-bfa3-da564b8d0acb tempest-TestServerVolumeAttachmentScenario-152127855 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-850f9143-3f3c-429c-a311-de6f4e0a766b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2afe006e-2f00-416d-b01b-15f5827e7bc7', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:27:09 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-bc881585-9712-4614-a909-86ea8ce54e02 req-d7424046-89ac-4fd8-bfa3-da564b8d0acb tempest-TestServerVolumeAttachmentScenario-152127855 None] attachment_update completed successfully. Jun 11 05:27:19 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:27:19 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:27:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-ca936259-2a3b-40fb-9c97-5d363340aa66 req-45454df6-cfe4-445d-afa3-7c9d99049573 tempest-TestServerVolumeAttachmentScenario-152127855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-ca936259-2a3b-40fb-9c97-5d363340aa66 req-45454df6-cfe4-445d-afa3-7c9d99049573 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:19 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcbdd9d-202c-4bb1-ba99-200cfcf0d16d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:27:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-ca936259-2a3b-40fb-9c97-5d363340aa66 req-45454df6-cfe4-445d-afa3-7c9d99049573 tempest-TestServerVolumeAttachmentScenario-152127855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:19 devstack sudo[110075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8 Jun 11 05:27:19 devstack sudo[110075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:20 devstack sudo[110075]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-ca936259-2a3b-40fb-9c97-5d363340aa66 req-45454df6-cfe4-445d-afa3-7c9d99049573 tempest-TestServerVolumeAttachmentScenario-152127855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8" returned: 0 in 0.826s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-ca936259-2a3b-40fb-9c97-5d363340aa66 req-45454df6-cfe4-445d-afa3-7c9d99049573 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.852s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-ca936259-2a3b-40fb-9c97-5d363340aa66 req-45454df6-cfe4-445d-afa3-7c9d99049573 tempest-TestServerVolumeAttachmentScenario-152127855 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2efd944-16a6-42c0-ab29-1a15f1583dd9', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:27:20 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-ca936259-2a3b-40fb-9c97-5d363340aa66 req-45454df6-cfe4-445d-afa3-7c9d99049573 tempest-TestServerVolumeAttachmentScenario-152127855 None] attachment_update completed successfully. Jun 11 05:27:26 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-75c987cb-4092-415f-8996-c53de9efa055 req-2cb04ced-ad15-4031-ac49-4f58f8cf1127 tempest-TestServerVolumeAttachmentScenario-152127855 None] Terminate volume connection completed successfully. Jun 11 05:27:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-75c987cb-4092-415f-8996-c53de9efa055 req-2cb04ced-ad15-4031-ac49-4f58f8cf1127 tempest-TestServerVolumeAttachmentScenario-152127855 None] Deleting attachment f2efd944-16a6-42c0-ab29-1a15f1583dd9. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:27:30 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-0fdd5f64-5820-4a48-9774-7003478dbae2 req-352ca0b4-3d86-49bb-bd48-c29fb0bc3a3b tempest-TestServerVolumeAttachmentScenario-152127855 None] Terminate volume connection completed successfully. Jun 11 05:27:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-0fdd5f64-5820-4a48-9774-7003478dbae2 req-352ca0b4-3d86-49bb-bd48-c29fb0bc3a3b tempest-TestServerVolumeAttachmentScenario-152127855 None] Deleting attachment 2afe006e-2f00-416d-b01b-15f5827e7bc7. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:27:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:27:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:27:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:27:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:30 devstack sudo[110118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:27:30 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:30 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.633s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:30 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:27:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:27:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:27:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:27:39 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:27:40 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:27:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Acquiring lock "cinder-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:27:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "cinder-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:27:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Acquiring lock "cinder-quobyte-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:27:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "cinder-quobyte-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:27:40 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1979b6fe-3f59-4a9c-bf0c-3e2021282935]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:27:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:40 devstack sudo[110176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8 Jun 11 05:27:40 devstack sudo[110176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:40 devstack sudo[110176]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8" returned: 0 in 0.689s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:40 devstack sudo[110181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8 Jun 11 05:27:40 devstack sudo[110181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:41 devstack sudo[110181]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8" returned: 0 in 0.600s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "cinder-quobyte-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8" released by "delete_volume" :: held 1.328s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:27:41 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Created reservations ['9f10bf37-baac-4c08-b908-54afa00f3dd7', 'dfc92320-f843-4286-9425-8a5478d631c0', '7c94e318-18c7-4f57-bfc2-5aef4e2d7137', '05079672-b9f0-4cdf-8628-aaf3b23bc564'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:27:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:27:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:27:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:41 devstack sudo[110184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:27:41 devstack sudo[110184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:42 devstack sudo[110184]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.577s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:42 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:27:42 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Deleted volume successfully. Jun 11 05:27:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b4c6302d-23fb-4806-b240-b7de96b9ca39 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "cinder-bd5cdea5-d262-42a9-9be5-cb2293d0e0c8-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:27:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Acquiring lock "cinder-850f9143-3f3c-429c-a311-de6f4e0a766b-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:27:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "cinder-850f9143-3f3c-429c-a311-de6f4e0a766b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:27:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Acquiring lock "cinder-quobyte-850f9143-3f3c-429c-a311-de6f4e0a766b" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:27:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "cinder-quobyte-850f9143-3f3c-429c-a311-de6f4e0a766b" acquired by "delete_volume" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:27:42 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0aa169-a9fc-4673-b4db-bb183f7c6a33]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:27:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:42 devstack sudo[110189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b Jun 11 05:27:42 devstack sudo[110189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Flow 'volume_create_manager' (9c6f1bcb-1877-4ecd-a486-04433c3954d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f7ce05-36bf-4872-988a-cc86e0ceb635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f7ce05-36bf-4872-988a-cc86e0ceb635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1947161143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26155256-8e2f-4ec8-8116-726fd4ecba72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e412e3dbd214dd69c1c931423d9b2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:43Z,use_quota=True,user_id='07c990d25df5426799a95f8778e1bc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b303bfb-624b-47bd-9702-f898f1adb800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b303bfb-624b-47bd-9702-f898f1adb800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c7c06c-b8ab-4dff-8ed3-0f3392f5d441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c7c06c-b8ab-4dff-8ed3-0f3392f5d441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26155256-8e2f-4ec8-8116-726fd4ecba72', 'volume_name': 'volume-26155256-8e2f-4ec8-8116-726fd4ecba72', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:43 devstack sudo[110189]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec1a194-326f-4019-ad75-9c6692918cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec1a194-326f-4019-ad75-9c6692918cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91506eef-70b6-4f94-926b-628cf527da2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:43 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Volume 26155256-8e2f-4ec8-8116-726fd4ecba72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26155256-8e2f-4ec8-8116-726fd4ecba72', 'volume_size': 1} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1947161143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26155256-8e2f-4ec8-8116-726fd4ecba72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e412e3dbd214dd69c1c931423d9b2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:43Z,use_quota=True,user_id='07c990d25df5426799a95f8778e1bc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Creating volume 26155256-8e2f-4ec8-8116-726fd4ecba72 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:27:43 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b" returned: 0 in 0.786s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:43 devstack sudo[110194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72 1073741824 Jun 11 05:27:43 devstack sudo[110194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:43 devstack sudo[110195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b Jun 11 05:27:43 devstack sudo[110195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:43 devstack sudo[110195]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-850f9143-3f3c-429c-a311-de6f4e0a766b" returned: 0 in 0.613s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "cinder-quobyte-850f9143-3f3c-429c-a311-de6f4e0a766b" released by "delete_volume" :: held 1.443s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Created reservations ['0e9725c7-2f79-423b-97a2-7c2e0b006184', 'c759a685-dee9-460b-a77c-3d4781ebb1ee', 'bd462eec-6390-4edd-916f-4a14f0d5aafe', '0149d0a7-ad79-4d12-9f27-b4a6b8ad78c1'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:43 devstack sudo[110194]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72 1073741824" returned: 0 in 0.790s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:43 devstack sudo[110204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:27:43 devstack sudo[110204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:44 devstack sudo[110206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72 Jun 11 05:27:44 devstack sudo[110206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:44 devstack sudo[110204]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.596s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:44 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:27:44 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Deleted volume successfully. Jun 11 05:27:44 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e371013b-5c8f-4cf5-a6af-4d1e2b6c0692 tempest-TestServerVolumeAttachmentScenario-152127855 None] Lock "cinder-850f9143-3f3c-429c-a311-de6f4e0a766b-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:27:44 devstack sudo[110206]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72" returned: 0 in 0.616s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:27:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91506eef-70b6-4f94-926b-628cf527da2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26155256-8e2f-4ec8-8116-726fd4ecba72', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40ff23b-1317-427a-9006-ae44747c6caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:44 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Volume volume-26155256-8e2f-4ec8-8116-726fd4ecba72 (26155256-8e2f-4ec8-8116-726fd4ecba72): created successfully Jun 11 05:27:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40ff23b-1317-427a-9006-ae44747c6caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Flow 'volume_create_manager' (9c6f1bcb-1877-4ecd-a486-04433c3954d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:27:44 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-fd3f1d3e-bc03-4e2c-908e-74446f57a138 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Created volume successfully. Jun 11 05:27:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-7e2aba7c-1979-46b9-8fc4-8a843c666dd3 req-18476662-0763-456e-98f3-cb5516dc0f22 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-7e2aba7c-1979-46b9-8fc4-8a843c666dd3 req-18476662-0763-456e-98f3-cb5516dc0f22 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:48 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49f3e39-eb59-45f7-b885-a87559c70c56]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:27:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-7e2aba7c-1979-46b9-8fc4-8a843c666dd3 req-18476662-0763-456e-98f3-cb5516dc0f22 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:48 devstack sudo[110220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72 Jun 11 05:27:48 devstack sudo[110220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:49 devstack sudo[110220]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [req-7e2aba7c-1979-46b9-8fc4-8a843c666dd3 req-18476662-0763-456e-98f3-cb5516dc0f22 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72" returned: 0 in 0.763s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [req-7e2aba7c-1979-46b9-8fc4-8a843c666dd3 req-18476662-0763-456e-98f3-cb5516dc0f22 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.784s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-7e2aba7c-1979-46b9-8fc4-8a843c666dd3 req-18476662-0763-456e-98f3-cb5516dc0f22 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2', 'name': 'volume-26155256-8e2f-4ec8-8116-726fd4ecba72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c36587af-93e5-4cad-8107-cd34579d7ef7', 'enforce_multipath': True} {{(pid=92308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 11 05:27:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-7e2aba7c-1979-46b9-8fc4-8a843c666dd3 req-18476662-0763-456e-98f3-cb5516dc0f22 tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] attachment_update completed successfully. Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Flow 'volume_create_manager' (f21212a3-57b5-416a-8637-005a05c64a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa39555a-effc-4f4d-a8d4-56a972774fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa39555a-effc-4f4d-a8d4-56a972774fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1865024080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae721af-6340-4a87-93ad-f77b4c0d51f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560ccbfc627549fc8d75fe834b904d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:54Z,use_quota=True,user_id='7ced1f4a17dd4b25be1f0e822bd65108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d615da7-bec0-44b1-be2b-ddf43690a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d615da7-bec0-44b1-be2b-ddf43690a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac4487f-d14c-4557-8c73-fc193a2be84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac4487f-d14c-4557-8c73-fc193a2be84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae721af-6340-4a87-93ad-f77b4c0d51f9', 'volume_name': 'volume-cae721af-6340-4a87-93ad-f77b4c0d51f9', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35784dd4-fce9-4d88-9018-b67fea3dde53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35784dd4-fce9-4d88-9018-b67fea3dde53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7157b1f2-d6a7-4d42-92c0-9dac9c610bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:54 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume cae721af-6340-4a87-93ad-f77b4c0d51f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae721af-6340-4a87-93ad-f77b4c0d51f9', 'volume_size': 1} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1865024080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae721af-6340-4a87-93ad-f77b4c0d51f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560ccbfc627549fc8d75fe834b904d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:54Z,use_quota=True,user_id='7ced1f4a17dd4b25be1f0e822bd65108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Creating volume cae721af-6340-4a87-93ad-f77b4c0d51f9 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:27:54 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:27:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cae721af-6340-4a87-93ad-f77b4c0d51f9 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:54 devstack sudo[110619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cae721af-6340-4a87-93ad-f77b4c0d51f9 1073741824 Jun 11 05:27:54 devstack sudo[110619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:55 devstack sudo[110619]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cae721af-6340-4a87-93ad-f77b4c0d51f9 1073741824" returned: 0 in 0.738s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cae721af-6340-4a87-93ad-f77b4c0d51f9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:55 devstack sudo[110625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cae721af-6340-4a87-93ad-f77b4c0d51f9 Jun 11 05:27:55 devstack sudo[110625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:55 devstack cinder-volume[92308]: INFO cinder.volume.manager [req-7dd2c93b-a0cc-4220-b1bc-5b81f23ba1ec req-07d411a2-f849-4d3f-bd51-9dd9d6d9edcc tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Terminate volume connection completed successfully. Jun 11 05:27:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [req-7dd2c93b-a0cc-4220-b1bc-5b81f23ba1ec req-07d411a2-f849-4d3f-bd51-9dd9d6d9edcc tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Deleting attachment c36587af-93e5-4cad-8107-cd34579d7ef7. {{(pid=92308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 11 05:27:55 devstack sudo[110625]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cae721af-6340-4a87-93ad-f77b4c0d51f9" returned: 0 in 0.609s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:27:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7157b1f2-d6a7-4d42-92c0-9dac9c610bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae721af-6340-4a87-93ad-f77b4c0d51f9', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:55 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b90d47c-0ac9-41a5-a9d6-3ff368f6c90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:56 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume volume-cae721af-6340-4a87-93ad-f77b4c0d51f9 (cae721af-6340-4a87-93ad-f77b4c0d51f9): created successfully Jun 11 05:27:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b90d47c-0ac9-41a5-a9d6-3ff368f6c90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Flow 'volume_create_manager' (f21212a3-57b5-416a-8637-005a05c64a8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:27:56 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a5f482ab-a49a-4f78-ab5e-26e59dfb8197 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Created volume successfully. Jun 11 05:27:56 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Flow 'volume_create_manager' (6bf9463a-9639-48ed-843b-b9c4b298e745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc005a1-37a3-4524-b17d-db9261332b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc005a1-37a3-4524-b17d-db9261332b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843190562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd3e0ea-8b20-4ccf-8d0d-313363d7f490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560ccbfc627549fc8d75fe834b904d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:57Z,use_quota=True,user_id='7ced1f4a17dd4b25be1f0e822bd65108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4908f53a-5f39-494a-a9a9-8197609df2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4908f53a-5f39-494a-a9a9-8197609df2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aec430c-473b-4262-a205-f48264f7f9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aec430c-473b-4262-a205-f48264f7f9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd3e0ea-8b20-4ccf-8d0d-313363d7f490', 'volume_name': 'volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5e13d8-1dd6-4da2-a6f7-740cf8f7f25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5e13d8-1dd6-4da2-a6f7-740cf8f7f25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3688e8f5-8204-4467-8d27-91a493b92e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume 5fd3e0ea-8b20-4ccf-8d0d-313363d7f490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490', 'volume_size': 1} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843190562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd3e0ea-8b20-4ccf-8d0d-313363d7f490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560ccbfc627549fc8d75fe834b904d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:57Z,use_quota=True,user_id='7ced1f4a17dd4b25be1f0e822bd65108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Creating volume 5fd3e0ea-8b20-4ccf-8d0d-313363d7f490 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:27:57 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:57 devstack sudo[110657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490 1073741824 Jun 11 05:27:57 devstack sudo[110657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Flow 'volume_create_manager' (8f8ab669-2f41-41d9-aa15-0fae81f40072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6059515-5573-4d9f-b5f8-99ff18445177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6059515-5573-4d9f-b5f8-99ff18445177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-816019340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560ccbfc627549fc8d75fe834b904d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:57Z,use_quota=True,user_id='7ced1f4a17dd4b25be1f0e822bd65108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbac6355-32c7-4d05-bcdb-4ca7b46f58f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbac6355-32c7-4d05-bcdb-4ca7b46f58f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78afdae2-1637-44aa-b86f-21c17e21a664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78afdae2-1637-44aa-b86f-21c17e21a664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4', 'volume_name': 'volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb50abd-6dc8-4b38-8ec7-8e490156fa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb50abd-6dc8-4b38-8ec7-8e490156fa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17193e17-e695-4956-9ad2-5e197b848f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume 11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4', 'volume_size': 1} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Flow 'volume_create_manager' (ab906005-f037-45e9-a5ec-ae5e00a83dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93cd03f-1a3b-4563-b917-1400d5a3c030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93cd03f-1a3b-4563-b917-1400d5a3c030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-378518521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05679d44-00a6-4888-9626-cd9651f39e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560ccbfc627549fc8d75fe834b904d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:58Z,use_quota=True,user_id='7ced1f4a17dd4b25be1f0e822bd65108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c18b74-3ba8-4e83-8b76-f78ca146d12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c18b74-3ba8-4e83-8b76-f78ca146d12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891c34a4-c285-4340-98f2-33c2e4f69ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891c34a4-c285-4340-98f2-33c2e4f69ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05679d44-00a6-4888-9626-cd9651f39e42', 'volume_name': 'volume-05679d44-00a6-4888-9626-cd9651f39e42', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52202680-01b9-4802-8b39-71429b3460f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52202680-01b9-4802-8b39-71429b3460f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46baf7b1-3479-472a-ab07-c88a31042bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:57 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume 05679d44-00a6-4888-9626-cd9651f39e42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05679d44-00a6-4888-9626-cd9651f39e42', 'volume_size': 1} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:57 devstack sudo[110657]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490 1073741824" returned: 0 in 0.889s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:57 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Flow 'volume_create_manager' (104417ed-3595-4e9c-8b24-27ba5ab55e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6f0da6-b872-430e-892a-9125082960d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6f0da6-b872-430e-892a-9125082960d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-579076706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ed7d86-3640-460d-829e-b5cafbb5f24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560ccbfc627549fc8d75fe834b904d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:58Z,use_quota=True,user_id='7ced1f4a17dd4b25be1f0e822bd65108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4634cedb-b187-4f39-b035-7a438a521c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4634cedb-b187-4f39-b035-7a438a521c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58d0642-3810-4300-bfa9-e5f3512034cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58d0642-3810-4300-bfa9-e5f3512034cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ed7d86-3640-460d-829e-b5cafbb5f24d', 'volume_name': 'volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d8a73b-d4f3-4e25-ac45-fa9a8ae4e0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d8a73b-d4f3-4e25-ac45-fa9a8ae4e0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41195ba-94db-4229-a112-a12727473fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:58 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume b9ed7d86-3640-460d-829e-b5cafbb5f24d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d', 'volume_size': 1} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Acquiring lock "cinder-26155256-8e2f-4ec8-8116-726fd4ecba72-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:27:58 devstack sudo[110663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490 Jun 11 05:27:58 devstack sudo[110663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Lock "cinder-26155256-8e2f-4ec8-8116-726fd4ecba72-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Acquiring lock "cinder-quobyte-26155256-8e2f-4ec8-8116-726fd4ecba72" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Lock "cinder-quobyte-26155256-8e2f-4ec8-8116-726fd4ecba72" acquired by "delete_volume" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[169b84f6-800d-47a3-b735-d518402d8665]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:58 devstack sudo[110665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72 Jun 11 05:27:58 devstack sudo[110665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Flow 'volume_create_manager' (2b87a2f8-42ba-4e0a-b325-4019312f225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ceedc4d-96d4-4f2a-914e-4e905b92fc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ceedc4d-96d4-4f2a-914e-4e905b92fc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-629270539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccacc0e-bd7b-4430-94db-fa83da3090e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560ccbfc627549fc8d75fe834b904d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:58Z,use_quota=True,user_id='7ced1f4a17dd4b25be1f0e822bd65108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef9ae9f-5be5-471f-8c7e-e93f1399b113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef9ae9f-5be5-471f-8c7e-e93f1399b113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86128a7-8acd-4130-b9fc-33171d9d25dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86128a7-8acd-4130-b9fc-33171d9d25dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fccacc0e-bd7b-4430-94db-fa83da3090e7', 'volume_name': 'volume-fccacc0e-bd7b-4430-94db-fa83da3090e7', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99fc988-2715-4369-9a42-543c31d28055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99fc988-2715-4369-9a42-543c31d28055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c484e1-cf78-42c5-a2ba-89c37039a6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:58 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume fccacc0e-bd7b-4430-94db-fa83da3090e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fccacc0e-bd7b-4430-94db-fa83da3090e7', 'volume_size': 1} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:58 devstack sudo[110663]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490" returned: 0 in 0.662s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.358s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-816019340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560ccbfc627549fc8d75fe834b904d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:57Z,use_quota=True,user_id='7ced1f4a17dd4b25be1f0e822bd65108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Creating volume 11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:27:58 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3688e8f5-8204-4467-8d27-91a493b92e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:58 devstack sudo[110668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4 1073741824 Jun 11 05:27:58 devstack sudo[110668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b88bd6-3f88-4b0a-89aa-9e1bfb617ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:27:58 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490 (5fd3e0ea-8b20-4ccf-8d0d-313363d7f490): created successfully Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b88bd6-3f88-4b0a-89aa-9e1bfb617ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Flow 'volume_create_manager' (6bf9463a-9639-48ed-843b-b9c4b298e745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:27:58 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-cd6d4ad7-e256-468a-a54b-f74299166607 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Created volume successfully. Jun 11 05:27:58 devstack sudo[110665]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72" returned: 0 in 0.741s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:58 devstack sudo[110674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72 Jun 11 05:27:58 devstack sudo[110674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:59 devstack sudo[110668]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4 1073741824" returned: 0 in 0.771s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:59 devstack sudo[110674]: pam_unix(sudo:session): session closed for user root Jun 11 05:27:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-26155256-8e2f-4ec8-8116-726fd4ecba72" returned: 0 in 0.617s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:27:59 devstack sudo[110680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4 Jun 11 05:27:59 devstack sudo[110680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:27:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Lock "cinder-quobyte-26155256-8e2f-4ec8-8116-726fd4ecba72" released by "delete_volume" :: held 1.402s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:27:59 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Created reservations ['2985cadf-4db9-4c45-9bf1-f2a624ca06f4', 'd2c2271e-51bb-4206-a650-2a5b7599c24f', '3dc587e9-b8e2-4b37-9c9b-ce986e2de790', 'c0a38158-f723-477d-98e4-bd27bf5fca87'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:27:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:27:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:27:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:27:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:27:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:27:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:27:59 devstack sudo[110682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:27:59 devstack sudo[110682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:00 devstack sudo[110680]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4" returned: 0 in 0.591s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.427s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-378518521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05679d44-00a6-4888-9626-cd9651f39e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560ccbfc627549fc8d75fe834b904d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:58Z,use_quota=True,user_id='7ced1f4a17dd4b25be1f0e822bd65108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Creating volume 05679d44-00a6-4888-9626-cd9651f39e42 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:28:00 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-05679d44-00a6-4888-9626-cd9651f39e42 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17193e17-e695-4956-9ad2-5e197b848f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:00 devstack sudo[110685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-05679d44-00a6-4888-9626-cd9651f39e42 1073741824 Jun 11 05:28:00 devstack sudo[110685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508a4e14-cf38-4d0e-b498-2b2ecad4d6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:00 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4 (11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4): created successfully Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508a4e14-cf38-4d0e-b498-2b2ecad4d6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Flow 'volume_create_manager' (8f8ab669-2f41-41d9-aa15-0fae81f40072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:00 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8c7e5740-c727-441b-9b2e-72127f4cb67b tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Created volume successfully. Jun 11 05:28:00 devstack sudo[110682]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.633s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:00 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Deleted volume successfully. Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-9791d42f-6e5a-408c-b436-9743de16ac2f tempest-TestServerVolumeAttachScenarioOldVersion-1570961528 None] Lock "cinder-26155256-8e2f-4ec8-8116-726fd4ecba72-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:00 devstack sudo[110685]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-05679d44-00a6-4888-9626-cd9651f39e42 1073741824" returned: 0 in 0.792s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-05679d44-00a6-4888-9626-cd9651f39e42 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:01 devstack sudo[110691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-05679d44-00a6-4888-9626-cd9651f39e42 Jun 11 05:28:01 devstack sudo[110691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:01 devstack sudo[110691]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-05679d44-00a6-4888-9626-cd9651f39e42" returned: 0 in 0.664s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.605s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-579076706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ed7d86-3640-460d-829e-b5cafbb5f24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560ccbfc627549fc8d75fe834b904d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:58Z,use_quota=True,user_id='7ced1f4a17dd4b25be1f0e822bd65108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Creating volume b9ed7d86-3640-460d-829e-b5cafbb5f24d {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:28:01 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46baf7b1-3479-472a-ab07-c88a31042bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05679d44-00a6-4888-9626-cd9651f39e42', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:01 devstack sudo[110731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d 1073741824 Jun 11 05:28:01 devstack sudo[110731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f926d8cf-a7a5-4086-81b5-9d64568e7aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:01 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume volume-05679d44-00a6-4888-9626-cd9651f39e42 (05679d44-00a6-4888-9626-cd9651f39e42): created successfully Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f926d8cf-a7a5-4086-81b5-9d64568e7aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Flow 'volume_create_manager' (ab906005-f037-45e9-a5ec-ae5e00a83dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:01 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-17c3089d-c3e6-4f78-aa5f-25bd02e576ce tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Created volume successfully. Jun 11 05:28:02 devstack sudo[110731]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d 1073741824" returned: 0 in 0.843s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:02 devstack sudo[110740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d Jun 11 05:28:02 devstack sudo[110740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:03 devstack sudo[110740]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d" returned: 0 in 0.599s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.677s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-629270539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccacc0e-bd7b-4430-94db-fa83da3090e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560ccbfc627549fc8d75fe834b904d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:27:58Z,use_quota=True,user_id='7ced1f4a17dd4b25be1f0e822bd65108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Creating volume fccacc0e-bd7b-4430-94db-fa83da3090e7 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:28:03 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fccacc0e-bd7b-4430-94db-fa83da3090e7 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41195ba-94db-4229-a112-a12727473fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:03 devstack sudo[110743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fccacc0e-bd7b-4430-94db-fa83da3090e7 1073741824 Jun 11 05:28:03 devstack sudo[110743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cf6138-bc8b-4f48-b766-3962d6fc13c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:03 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d (b9ed7d86-3640-460d-829e-b5cafbb5f24d): created successfully Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cf6138-bc8b-4f48-b766-3962d6fc13c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:03 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Flow 'volume_create_manager' (104417ed-3595-4e9c-8b24-27ba5ab55e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:03 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-6f23f04d-9adf-4a2a-93fb-a464fd120991 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Created volume successfully. Jun 11 05:28:04 devstack sudo[110743]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fccacc0e-bd7b-4430-94db-fa83da3090e7 1073741824" returned: 0 in 0.853s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fccacc0e-bd7b-4430-94db-fa83da3090e7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:04 devstack sudo[110757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fccacc0e-bd7b-4430-94db-fa83da3090e7 Jun 11 05:28:04 devstack sudo[110757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:04 devstack sudo[110757]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fccacc0e-bd7b-4430-94db-fa83da3090e7" returned: 0 in 0.626s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:28:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c484e1-cf78-42c5-a2ba-89c37039a6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fccacc0e-bd7b-4430-94db-fa83da3090e7', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa1c86d-b181-44c0-9646-9997eb091473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:04 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Volume volume-fccacc0e-bd7b-4430-94db-fa83da3090e7 (fccacc0e-bd7b-4430-94db-fa83da3090e7): created successfully Jun 11 05:28:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa1c86d-b181-44c0-9646-9997eb091473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:04 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Flow 'volume_create_manager' (2b87a2f8-42ba-4e0a-b325-4019312f225a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:04 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-bfc7b5df-b066-4c23-aa18-25d89967be22 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Created volume successfully. Jun 11 05:28:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "cinder-fccacc0e-bd7b-4430-94db-fa83da3090e7-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-fccacc0e-bd7b-4430-94db-fa83da3090e7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "cinder-quobyte-fccacc0e-bd7b-4430-94db-fa83da3090e7" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-quobyte-fccacc0e-bd7b-4430-94db-fa83da3090e7" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:05 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f0ddfc-e4ea-4408-ba83-bacede7903e5]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fccacc0e-bd7b-4430-94db-fa83da3090e7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:05 devstack sudo[110761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fccacc0e-bd7b-4430-94db-fa83da3090e7 Jun 11 05:28:05 devstack sudo[110761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:05 devstack sudo[110761]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fccacc0e-bd7b-4430-94db-fa83da3090e7" returned: 0 in 0.724s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fccacc0e-bd7b-4430-94db-fa83da3090e7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:05 devstack sudo[110766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fccacc0e-bd7b-4430-94db-fa83da3090e7 Jun 11 05:28:05 devstack sudo[110766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:06 devstack sudo[110766]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fccacc0e-bd7b-4430-94db-fa83da3090e7" returned: 0 in 0.610s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-quobyte-fccacc0e-bd7b-4430-94db-fa83da3090e7" released by "delete_volume" :: held 1.376s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:06 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Created reservations ['a4aa3900-6f7b-409c-9961-0b2d5097d7ec', 'a7e17abd-e2d1-440f-aa18-dff1cac3ac91', '78b060e3-4f83-4485-99e6-97420d4c9a92', 'cec472f4-9e09-4e7d-aa98-30776d99d022'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:06 devstack sudo[110769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:06 devstack sudo[110769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:07 devstack sudo[110769]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.596s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:07 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:07 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Deleted volume successfully. Jun 11 05:28:07 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-64c87b76-aac5-4b49-b541-507932919685 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-fccacc0e-bd7b-4430-94db-fa83da3090e7-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:07 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "cinder-b9ed7d86-3640-460d-829e-b5cafbb5f24d-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:07 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-b9ed7d86-3640-460d-829e-b5cafbb5f24d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:07 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "cinder-quobyte-b9ed7d86-3640-460d-829e-b5cafbb5f24d" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:07 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-quobyte-b9ed7d86-3640-460d-829e-b5cafbb5f24d" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:07 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a60923-c377-416c-b785-ecbadeeef55d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:07 devstack sudo[110772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d Jun 11 05:28:07 devstack sudo[110772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:08 devstack sudo[110772]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d" returned: 0 in 0.717s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:08 devstack sudo[110777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d Jun 11 05:28:08 devstack sudo[110777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:08 devstack sudo[110777]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b9ed7d86-3640-460d-829e-b5cafbb5f24d" returned: 0 in 0.613s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:08 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-quobyte-b9ed7d86-3640-460d-829e-b5cafbb5f24d" released by "delete_volume" :: held 1.368s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:08 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Created reservations ['93d093fb-3e19-4dc7-97d1-1db18871ca1e', '7a3ee312-6c97-424d-8489-fab8f4170db8', '5e33e548-d4d5-4695-8ee0-957411694a71', '39120606-563f-42a7-b5a6-b8af70aea153'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:08 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:08 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:08 devstack sudo[110780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:08 devstack sudo[110780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:09 devstack sudo[110780]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.600s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:09 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:09 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Deleted volume successfully. Jun 11 05:28:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "cinder-05679d44-00a6-4888-9626-cd9651f39e42-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-05679d44-00a6-4888-9626-cd9651f39e42-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-45fe57e5-b38a-4372-9a1f-796c45a59295 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-b9ed7d86-3640-460d-829e-b5cafbb5f24d-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "cinder-quobyte-05679d44-00a6-4888-9626-cd9651f39e42" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-quobyte-05679d44-00a6-4888-9626-cd9651f39e42" acquired by "delete_volume" :: waited 0.017s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:09 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4215c34b-1b22-4b5e-839b-3841566cf5b1]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-05679d44-00a6-4888-9626-cd9651f39e42 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:09 devstack sudo[110783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-05679d44-00a6-4888-9626-cd9651f39e42 Jun 11 05:28:09 devstack sudo[110783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:10 devstack sudo[110783]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-05679d44-00a6-4888-9626-cd9651f39e42" returned: 0 in 0.764s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-05679d44-00a6-4888-9626-cd9651f39e42 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:10 devstack sudo[110790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-05679d44-00a6-4888-9626-cd9651f39e42 Jun 11 05:28:10 devstack sudo[110790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:11 devstack sudo[110790]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-05679d44-00a6-4888-9626-cd9651f39e42" returned: 0 in 0.633s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-quobyte-05679d44-00a6-4888-9626-cd9651f39e42" released by "delete_volume" :: held 1.473s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Created reservations ['fd6a2af3-0d80-4f38-9a5a-56ebd43de644', 'cd021c59-831d-4fae-9868-2174fa7720e5', '577808c2-3775-41d9-9133-04c04a2a9625', '19c0c384-3f54-480c-b5e2-62364351fb76'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:11 devstack sudo[110793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:11 devstack sudo[110793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "cinder-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "cinder-quobyte-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:11 devstack sudo[110793]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.671s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:11 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Deleted volume successfully. Jun 11 05:28:11 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-quobyte-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4" acquired by "delete_volume" :: waited 0.031s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-7ff76446-cf65-4cbb-a2c1-3337551201b6 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-05679d44-00a6-4888-9626-cd9651f39e42-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:12 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b4c6f6-98ca-41cc-a78f-eed79fefb0b6]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:12 devstack sudo[110797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4 Jun 11 05:28:12 devstack sudo[110797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:12 devstack sudo[110797]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4" returned: 0 in 0.728s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:12 devstack sudo[110802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4 Jun 11 05:28:12 devstack sudo[110802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:13 devstack sudo[110802]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4" returned: 0 in 0.589s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:13 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-quobyte-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4" released by "delete_volume" :: held 1.389s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:13 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Created reservations ['f8a03d26-2004-4cec-b70f-626346cda8d8', 'd49abc3d-2b8d-4e5b-942e-2724b01e805f', '98be4fef-cf1b-4910-b1cc-9d14a0742c8d', 'b02a6438-703f-46be-9779-25a75b40dbda'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:13 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:13 devstack sudo[110806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:13 devstack sudo[110806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:14 devstack sudo[110806]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.614s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:14 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:14 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Deleted volume successfully. Jun 11 05:28:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "cinder-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-ac524bc1-4156-4956-9619-d7a7aac5c94c tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-11920ecc-1c7c-47fe-a7e4-09e5dd2ad8d4-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "cinder-quobyte-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-quobyte-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:14 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47378d9-27cd-4548-b3ae-ab5241ca72bc]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:14 devstack sudo[110810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490 Jun 11 05:28:14 devstack sudo[110810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:15 devstack sudo[110810]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490" returned: 0 in 0.799s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:15 devstack sudo[110815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490 Jun 11 05:28:15 devstack sudo[110815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:15 devstack sudo[110815]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490" returned: 0 in 0.642s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-quobyte-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490" released by "delete_volume" :: held 1.504s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:15 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Created reservations ['00bcbbad-5c4f-444b-bcb3-1d2c37e24189', '565c0624-626b-417f-a2ed-9d21495043ef', 'a128b085-61a1-4846-8a7c-e35cdb9d01fe', '822ef2ed-7026-467e-a782-4a45e7670050'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:15 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:15 devstack sudo[110819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:15 devstack sudo[110819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "cinder-cae721af-6340-4a87-93ad-f77b4c0d51f9-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-cae721af-6340-4a87-93ad-f77b4c0d51f9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "cinder-quobyte-cae721af-6340-4a87-93ad-f77b4c0d51f9" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-quobyte-cae721af-6340-4a87-93ad-f77b4c0d51f9" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:16 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4884ae76-531f-48a0-92be-a02de5c25653]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cae721af-6340-4a87-93ad-f77b4c0d51f9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:16 devstack sudo[110819]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.697s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:16 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:16 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Deleted volume successfully. Jun 11 05:28:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e5e4e853-e76a-4f0c-a716-f0eea40e7b27 tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-5fd3e0ea-8b20-4ccf-8d0d-313363d7f490-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:16 devstack sudo[110822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cae721af-6340-4a87-93ad-f77b4c0d51f9 Jun 11 05:28:16 devstack sudo[110822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:17 devstack sudo[110822]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cae721af-6340-4a87-93ad-f77b4c0d51f9" returned: 0 in 0.825s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cae721af-6340-4a87-93ad-f77b4c0d51f9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:17 devstack sudo[110865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cae721af-6340-4a87-93ad-f77b4c0d51f9 Jun 11 05:28:17 devstack sudo[110865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:17 devstack sudo[110865]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cae721af-6340-4a87-93ad-f77b4c0d51f9" returned: 0 in 0.599s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:17 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-quobyte-cae721af-6340-4a87-93ad-f77b4c0d51f9" released by "delete_volume" :: held 1.473s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:17 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Created reservations ['16995584-e187-4986-af2f-547da62da2b5', 'aec037da-e282-439f-9ab4-08755107c401', 'f4837476-ef2c-4375-9302-db1f78598b17', '2697b417-754b-4d9f-9909-0541df4a1d35'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:18 devstack sudo[110868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:18 devstack sudo[110868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:18 devstack sudo[110868]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.632s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:18 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Deleted volume successfully. Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-882dc295-8e22-4963-af8b-0f74dfbf5f2d tempest-CreateVolumesFromSourceVolumeTest-1593830839 None] Lock "cinder-cae721af-6340-4a87-93ad-f77b4c0d51f9-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Flow 'volume_create_manager' (2dd1ea8c-7456-4931-8fae-00470ad935e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2a7dba-5d47-44b9-88d0-b28ea1bd2f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2a7dba-5d47-44b9-88d0-b28ea1bd2f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-445899428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a745c8-b759-48ce-954f-6b088349a178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63808b42678c4d519bed8de558a3befe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:19Z,use_quota=True,user_id='0b6e301b7ece4806b18292727470b247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f9fab4-9e29-4336-aa1d-7fe5793fb05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f9fab4-9e29-4336-aa1d-7fe5793fb05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1567cc04-7251-491a-86ef-0f23c4edca5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1567cc04-7251-491a-86ef-0f23c4edca5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66a745c8-b759-48ce-954f-6b088349a178', 'volume_name': 'volume-66a745c8-b759-48ce-954f-6b088349a178', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292eeb11-2423-4de9-b4ce-c656ba78f27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292eeb11-2423-4de9-b4ce-c656ba78f27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae4beab-7c46-4b91-a420-3c8a14e74998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:18 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume 66a745c8-b759-48ce-954f-6b088349a178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66a745c8-b759-48ce-954f-6b088349a178', 'volume_size': 1} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-445899428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a745c8-b759-48ce-954f-6b088349a178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63808b42678c4d519bed8de558a3befe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:19Z,use_quota=True,user_id='0b6e301b7ece4806b18292727470b247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Creating volume 66a745c8-b759-48ce-954f-6b088349a178 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:28:18 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:28:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:18 devstack sudo[110871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178 1073741824 Jun 11 05:28:18 devstack sudo[110871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:19 devstack sudo[110871]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178 1073741824" returned: 0 in 0.855s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:19 devstack sudo[110877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178 Jun 11 05:28:19 devstack sudo[110877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:20 devstack sudo[110877]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178" returned: 0 in 0.639s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:20 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:28:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae4beab-7c46-4b91-a420-3c8a14e74998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66a745c8-b759-48ce-954f-6b088349a178', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38482f20-f8e9-40ae-8902-f710a188b61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:20 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume volume-66a745c8-b759-48ce-954f-6b088349a178 (66a745c8-b759-48ce-954f-6b088349a178): created successfully Jun 11 05:28:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38482f20-f8e9-40ae-8902-f710a188b61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Flow 'volume_create_manager' (2dd1ea8c-7456-4931-8fae-00470ad935e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:20 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-37f8b265-7bd0-4b24-9719-6b2e3bea2999 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Created volume successfully. Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Creating offline snapshot 9e466f9d-a422-401c-9425-46f4ccc7ad90 of volume 66a745c8-b759-48ce-954f-6b088349a178 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26d6b7a-32bb-4856-90cc-4c3ea2a18148]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:21 devstack sudo[110882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178 Jun 11 05:28:21 devstack sudo[110882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Flow 'volume_create_manager' (1dbb7803-f05f-488c-b5fe-d6d2ae1203a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d820b7d-9ae5-4d75-9367-38166706f92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d820b7d-9ae5-4d75-9367-38166706f92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1205475016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbcafeda-9efe-445c-9dba-732b637e2e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ed193d8be746ac98c69ec9c55eda4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:21Z,use_quota=True,user_id='0e2ade724f384506a6cebb017ce106c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92af9fc5-ca48-4c2f-bc22-2d147fee6786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92af9fc5-ca48-4c2f-bc22-2d147fee6786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a38301-8a79-45e4-bfba-df8f71a80358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a38301-8a79-45e4-bfba-df8f71a80358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbcafeda-9efe-445c-9dba-732b637e2e77', 'volume_name': 'volume-cbcafeda-9efe-445c-9dba-732b637e2e77', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c7d260-e2bc-4251-942e-9ac28269f817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c7d260-e2bc-4251-942e-9ac28269f817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed70094-d335-4b75-8a9a-28309f4a3d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:21 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Volume cbcafeda-9efe-445c-9dba-732b637e2e77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbcafeda-9efe-445c-9dba-732b637e2e77', 'volume_size': 1} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:21 devstack sudo[110882]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178" returned: 0 in 0.724s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:21 devstack sudo[110887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 1G Jun 11 05:28:21 devstack sudo[110887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:22 devstack sudo[110887]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 1G" returned: 0 in 0.743s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66a745c8-b759-48ce-954f-6b088349a178 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:22 devstack sudo[110892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66a745c8-b759-48ce-954f-6b088349a178 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 Jun 11 05:28:22 devstack sudo[110892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:23 devstack sudo[110892]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66a745c8-b759-48ce-954f-6b088349a178 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90" returned: 0 in 0.644s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:23 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 is being set with open permissions: ugo+rw Jun 11 05:28:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:23 devstack sudo[110897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 Jun 11 05:28:23 devstack sudo[110897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:23 devstack sudo[110897]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90" returned: 0 in 0.566s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:23 devstack sudo[110901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.info Jun 11 05:28:23 devstack sudo[110901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:24 devstack sudo[110901]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.info" returned: 0 in 0.600s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:24 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.info is being set with open permissions: ugo+rw Jun 11 05:28:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:24 devstack sudo[110904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.info Jun 11 05:28:24 devstack sudo[110904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:25 devstack sudo[110904]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.info" returned: 0 in 0.589s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.956s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.653s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1205475016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbcafeda-9efe-445c-9dba-732b637e2e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ed193d8be746ac98c69ec9c55eda4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:21Z,use_quota=True,user_id='0e2ade724f384506a6cebb017ce106c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Creating volume cbcafeda-9efe-445c-9dba-732b637e2e77 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:28:25 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:25 devstack sudo[110907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 1073741824 Jun 11 05:28:25 devstack sudo[110907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:25 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-48d8a5ef-7ee3-4857-b2ae-e1152dadc968 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Create snapshot completed successfully Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Flow 'volume_create_manager' (31d1c0ea-7828-4dd8-aafd-bd460b02486a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47cfbc8-cda3-4f40-89de-9cb8eda38d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47cfbc8-cda3-4f40-89de-9cb8eda38d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2119870910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1073e101-0f25-477c-8935-3584812deffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63808b42678c4d519bed8de558a3befe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:26Z,use_quota=True,user_id='0b6e301b7ece4806b18292727470b247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d9a5d0-6839-4317-8bb4-406675bf841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d9a5d0-6839-4317-8bb4-406675bf841e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5916ba20-c88a-4ff0-a0a7-0432a85e54cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5916ba20-c88a-4ff0-a0a7-0432a85e54cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1073e101-0f25-477c-8935-3584812deffb', 'volume_name': 'volume-1073e101-0f25-477c-8935-3584812deffb', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23249492-5970-4166-b925-10994a65fdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23249492-5970-4166-b925-10994a65fdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7737ed94-adce-4b5c-8566-4cd29296c935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:25 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume 1073e101-0f25-477c-8935-3584812deffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1073e101-0f25-477c-8935-3584812deffb', 'volume_size': 1} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:28:25 devstack sudo[110907]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Flow 'volume_create_manager' (7d1ffa65-0a8f-467f-a349-8af6873308eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ad8442-4ae5-4ec3-8bb2-59d756b461dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 1073741824" returned: 0 in 0.914s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ad8442-4ae5-4ec3-8bb2-59d756b461dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-822394101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63808b42678c4d519bed8de558a3befe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:26Z,use_quota=True,user_id='0b6e301b7ece4806b18292727470b247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08f946d-923d-4f10-9105-bc497150915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08f946d-923d-4f10-9105-bc497150915f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb69100b-ba80-4981-bc42-41da5e8b1124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb69100b-ba80-4981-bc42-41da5e8b1124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd', 'volume_name': 'volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c5f204-8f98-4adc-b34d-cfac0d1c6039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c5f204-8f98-4adc-b34d-cfac0d1c6039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df89c866-1668-4a55-9266-f30b96ddc2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume 8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd', 'volume_size': 1} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:26 devstack sudo[110913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 Jun 11 05:28:26 devstack sudo[110913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Flow 'volume_create_manager' (6f109e81-c2a1-4240-8115-7d64431c5c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5ef975-732b-4926-8061-aabbd280e6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5ef975-732b-4926-8061-aabbd280e6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1679967505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f61129-b674-4732-9dac-cea85408be45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63808b42678c4d519bed8de558a3befe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:26Z,use_quota=True,user_id='0b6e301b7ece4806b18292727470b247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d82874-4ec1-4ca8-a3aa-08820875fc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d82874-4ec1-4ca8-a3aa-08820875fc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1387a8-8d2a-4150-ba79-5acb7adb80a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1387a8-8d2a-4150-ba79-5acb7adb80a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f61129-b674-4732-9dac-cea85408be45', 'volume_name': 'volume-02f61129-b674-4732-9dac-cea85408be45', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380d549e-1889-4f87-bb65-e93d4500b9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380d549e-1889-4f87-bb65-e93d4500b9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398e019b-ba4a-453e-9370-58f958879bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume 02f61129-b674-4732-9dac-cea85408be45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f61129-b674-4732-9dac-cea85408be45', 'volume_size': 1} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Flow 'volume_create_manager' (5df58ac2-20f4-4d2f-8b12-230048737455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ac2316-181a-402b-a253-fb97ba271b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ac2316-181a-402b-a253-fb97ba271b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1799910661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa2a85d-a309-4983-9800-2da52ef965ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63808b42678c4d519bed8de558a3befe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:27Z,use_quota=True,user_id='0b6e301b7ece4806b18292727470b247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b41704-f843-4d75-b36b-dfb5ba340d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b41704-f843-4d75-b36b-dfb5ba340d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e6c5ac-97dd-47d8-81f0-291e875946b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e6c5ac-97dd-47d8-81f0-291e875946b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa2a85d-a309-4983-9800-2da52ef965ca', 'volume_name': 'volume-2aa2a85d-a309-4983-9800-2da52ef965ca', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5d470a-ca8f-4d13-a7f7-7056b1846a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5d470a-ca8f-4d13-a7f7-7056b1846a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36f56ca-a57c-4e63-9cd0-3db0b803da0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume 2aa2a85d-a309-4983-9800-2da52ef965ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa2a85d-a309-4983-9800-2da52ef965ca', 'volume_size': 1} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:26 devstack sudo[110913]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77" returned: 0 in 0.656s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.015s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2119870910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1073e101-0f25-477c-8935-3584812deffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63808b42678c4d519bed8de558a3befe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:26Z,use_quota=True,user_id='0b6e301b7ece4806b18292727470b247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Creating volume 1073e101-0f25-477c-8935-3584812deffb {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:28:26 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1073e101-0f25-477c-8935-3584812deffb 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed70094-d335-4b75-8a9a-28309f4a3d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbcafeda-9efe-445c-9dba-732b637e2e77', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack sudo[110916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1073e101-0f25-477c-8935-3584812deffb 1073741824 Jun 11 05:28:26 devstack sudo[110916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dc4ed6-2bc3-471b-b430-a4347215c27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:26 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Volume volume-cbcafeda-9efe-445c-9dba-732b637e2e77 (cbcafeda-9efe-445c-9dba-732b637e2e77): created successfully Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dc4ed6-2bc3-471b-b430-a4347215c27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Flow 'volume_create_manager' (1dbb7803-f05f-488c-b5fe-d6d2ae1203a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:26 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2318519d-b85a-42a7-8964-52e12100d1a8 tempest-VolumeDependencyTests-1758130098 None] Created volume successfully. Jun 11 05:28:26 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Flow 'volume_create_manager' (f3c9d046-f953-4d77-8908-1eb555102d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cafd91-f9ed-4052-8be8-f06e2a7ea969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cafd91-f9ed-4052-8be8-f06e2a7ea969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-861425966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db4cc80-7549-4704-9f70-508b7daf600d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63808b42678c4d519bed8de558a3befe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:27Z,use_quota=True,user_id='0b6e301b7ece4806b18292727470b247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d636b7-ce72-442f-b689-304b0faccd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d636b7-ce72-442f-b689-304b0faccd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0227cb8a-60e7-487e-917d-8be6cc7eeb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0227cb8a-60e7-487e-917d-8be6cc7eeb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db4cc80-7549-4704-9f70-508b7daf600d', 'volume_name': 'volume-7db4cc80-7549-4704-9f70-508b7daf600d', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed484015-1ea5-42b8-96ae-cdab9260a3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed484015-1ea5-42b8-96ae-cdab9260a3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5c57a1-4006-45c8-9158-e2b9f9295970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:27 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume 7db4cc80-7549-4704-9f70-508b7daf600d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db4cc80-7549-4704-9f70-508b7daf600d', 'volume_size': 1} Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:27 devstack sudo[110916]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1073e101-0f25-477c-8935-3584812deffb 1073741824" returned: 0 in 0.760s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1073e101-0f25-477c-8935-3584812deffb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:27 devstack sudo[110921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1073e101-0f25-477c-8935-3584812deffb Jun 11 05:28:27 devstack sudo[110921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:28 devstack sudo[110921]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1073e101-0f25-477c-8935-3584812deffb" returned: 0 in 0.585s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.065s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-822394101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63808b42678c4d519bed8de558a3befe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:26Z,use_quota=True,user_id='0b6e301b7ece4806b18292727470b247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Creating volume 8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:28:28 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7737ed94-adce-4b5c-8566-4cd29296c935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1073e101-0f25-477c-8935-3584812deffb', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb4f9b7-155a-4097-80f6-7bfbe3f958c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:28 devstack sudo[110924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd 1073741824 Jun 11 05:28:28 devstack sudo[110924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:28 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume volume-1073e101-0f25-477c-8935-3584812deffb (1073e101-0f25-477c-8935-3584812deffb): created successfully Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb4f9b7-155a-4097-80f6-7bfbe3f958c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Flow 'volume_create_manager' (31d1c0ea-7828-4dd8-aafd-bd460b02486a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:28 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f0a4d4d7-e1d2-4af7-b265-901a279cf335 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Created volume successfully. Jun 11 05:28:28 devstack sudo[110924]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd 1073741824" returned: 0 in 0.740s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:28 devstack sudo[110929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd Jun 11 05:28:28 devstack sudo[110929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:29 devstack sudo[110929]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd" returned: 0 in 0.574s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.088s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1679967505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f61129-b674-4732-9dac-cea85408be45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63808b42678c4d519bed8de558a3befe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:26Z,use_quota=True,user_id='0b6e301b7ece4806b18292727470b247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Creating volume 02f61129-b674-4732-9dac-cea85408be45 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:28:29 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-02f61129-b674-4732-9dac-cea85408be45 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:29 devstack sudo[110932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-02f61129-b674-4732-9dac-cea85408be45 1073741824 Jun 11 05:28:29 devstack sudo[110932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df89c866-1668-4a55-9266-f30b96ddc2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcb8936-1318-43de-88fd-7e7d3d5dae5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:29 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd (8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd): created successfully Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcb8936-1318-43de-88fd-7e7d3d5dae5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Flow 'volume_create_manager' (7d1ffa65-0a8f-467f-a349-8af6873308eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:29 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-628ebb63-5385-40a8-9dc8-734804f6cc7b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Created volume successfully. Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:30 devstack sudo[110932]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-02f61129-b674-4732-9dac-cea85408be45 1073741824" returned: 0 in 0.798s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:30 devstack sudo[110937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:30 devstack sudo[110937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-02f61129-b674-4732-9dac-cea85408be45 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:30 devstack sudo[110939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-02f61129-b674-4732-9dac-cea85408be45 Jun 11 05:28:30 devstack sudo[110939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:30 devstack sudo[110937]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.580s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:28:30 devstack sudo[110939]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-02f61129-b674-4732-9dac-cea85408be45" returned: 0 in 0.597s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.193s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1799910661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa2a85d-a309-4983-9800-2da52ef965ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63808b42678c4d519bed8de558a3befe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:27Z,use_quota=True,user_id='0b6e301b7ece4806b18292727470b247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Creating volume 2aa2a85d-a309-4983-9800-2da52ef965ca {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:28:30 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2aa2a85d-a309-4983-9800-2da52ef965ca 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:30 devstack sudo[110943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2aa2a85d-a309-4983-9800-2da52ef965ca 1073741824 Jun 11 05:28:30 devstack sudo[110943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398e019b-ba4a-453e-9370-58f958879bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f61129-b674-4732-9dac-cea85408be45', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d61d50-5d80-4d3b-b9db-11a9d3651135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:30 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume volume-02f61129-b674-4732-9dac-cea85408be45 (02f61129-b674-4732-9dac-cea85408be45): created successfully Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d61d50-5d80-4d3b-b9db-11a9d3651135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Flow 'volume_create_manager' (6f109e81-c2a1-4240-8115-7d64431c5c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:31 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b4dc1117-af55-4054-b594-53a62a88c945 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Created volume successfully. Jun 11 05:28:31 devstack sudo[110943]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2aa2a85d-a309-4983-9800-2da52ef965ca 1073741824" returned: 0 in 0.746s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2aa2a85d-a309-4983-9800-2da52ef965ca {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:31 devstack sudo[110948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2aa2a85d-a309-4983-9800-2da52ef965ca Jun 11 05:28:31 devstack sudo[110948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:32 devstack sudo[110948]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2aa2a85d-a309-4983-9800-2da52ef965ca" returned: 0 in 0.591s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.230s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-861425966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db4cc80-7549-4704-9f70-508b7daf600d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63808b42678c4d519bed8de558a3befe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:27Z,use_quota=True,user_id='0b6e301b7ece4806b18292727470b247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Creating volume 7db4cc80-7549-4704-9f70-508b7daf600d {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:28:32 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7db4cc80-7549-4704-9f70-508b7daf600d 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36f56ca-a57c-4e63-9cd0-3db0b803da0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa2a85d-a309-4983-9800-2da52ef965ca', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:32 devstack sudo[110951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7db4cc80-7549-4704-9f70-508b7daf600d 1073741824 Jun 11 05:28:32 devstack sudo[110951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af438372-e154-497f-b71e-c9d7b5505fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:32 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume volume-2aa2a85d-a309-4983-9800-2da52ef965ca (2aa2a85d-a309-4983-9800-2da52ef965ca): created successfully Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af438372-e154-497f-b71e-c9d7b5505fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:32 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Flow 'volume_create_manager' (5df58ac2-20f4-4d2f-8b12-230048737455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:32 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c0d6f83f-6569-4409-b4d8-f289bea10235 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Created volume successfully. Jun 11 05:28:33 devstack sudo[110951]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7db4cc80-7549-4704-9f70-508b7daf600d 1073741824" returned: 0 in 0.749s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7db4cc80-7549-4704-9f70-508b7daf600d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:33 devstack sudo[110956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7db4cc80-7549-4704-9f70-508b7daf600d Jun 11 05:28:33 devstack sudo[110956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:33 devstack sudo[110956]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7db4cc80-7549-4704-9f70-508b7daf600d" returned: 0 in 0.593s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:28:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.778s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5c57a1-4006-45c8-9158-e2b9f9295970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db4cc80-7549-4704-9f70-508b7daf600d', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7dc4b3a-dbb1-4e23-9edb-d6b7383b9b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] Creating offline snapshot 9507ebec-ffb0-4939-85ba-a5d81ab31209 of volume cbcafeda-9efe-445c-9dba-732b637e2e77 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:28:33 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Volume volume-7db4cc80-7549-4704-9f70-508b7daf600d (7db4cc80-7549-4704-9f70-508b7daf600d): created successfully Jun 11 05:28:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7dc4b3a-dbb1-4e23-9edb-d6b7383b9b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Flow 'volume_create_manager' (f3c9d046-f953-4d77-8908-1eb555102d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:33 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[da93960a-f2a5-491d-9c26-c85f8d774c02]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:33 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-4339e813-f14b-47e7-b38d-168cf161390b tempest-CreateVolumesFromSnapshotTest-1437967209 None] Created volume successfully. Jun 11 05:28:33 devstack sudo[110959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 Jun 11 05:28:33 devstack sudo[110959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:34 devstack sudo[110959]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77" returned: 0 in 0.698s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:34 devstack sudo[110965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 1G Jun 11 05:28:34 devstack sudo[110965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:34 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-7db4cc80-7549-4704-9f70-508b7daf600d-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:34 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-7db4cc80-7549-4704-9f70-508b7daf600d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:34 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-quobyte-7db4cc80-7549-4704-9f70-508b7daf600d" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:34 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-7db4cc80-7549-4704-9f70-508b7daf600d" acquired by "delete_volume" :: waited 0.022s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:34 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3802c5-603f-4efd-b2fc-70c39f6a3a76]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7db4cc80-7549-4704-9f70-508b7daf600d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:34 devstack sudo[110967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7db4cc80-7549-4704-9f70-508b7daf600d Jun 11 05:28:34 devstack sudo[110967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:35 devstack sudo[110965]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 1G" returned: 0 in 0.762s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbcafeda-9efe-445c-9dba-732b637e2e77 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:35 devstack sudo[110972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbcafeda-9efe-445c-9dba-732b637e2e77 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 Jun 11 05:28:35 devstack sudo[110972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:35 devstack sudo[110967]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7db4cc80-7549-4704-9f70-508b7daf600d" returned: 0 in 0.713s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7db4cc80-7549-4704-9f70-508b7daf600d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:35 devstack sudo[110977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7db4cc80-7549-4704-9f70-508b7daf600d Jun 11 05:28:35 devstack sudo[110977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:35 devstack sudo[110972]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbcafeda-9efe-445c-9dba-732b637e2e77 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209" returned: 0 in 0.637s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:35 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 is being set with open permissions: ugo+rw Jun 11 05:28:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:35 devstack sudo[110982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 Jun 11 05:28:35 devstack sudo[110982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:36 devstack sudo[110977]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-7db4cc80-7549-4704-9f70-508b7daf600d" returned: 0 in 0.578s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-7db4cc80-7549-4704-9f70-508b7daf600d" released by "delete_volume" :: held 1.335s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Created reservations ['47b16518-ef13-4ee6-b0b6-e94a0d3132f2', '0e832211-d750-4b08-b77e-eb41ba877330', '369604f1-b2ee-475d-88cf-3c7a074e95fc', '92065829-7925-401b-b975-851487b14ee8'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:36 devstack sudo[110985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:36 devstack sudo[110985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:36 devstack sudo[110982]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209" returned: 0 in 0.579s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:36 devstack sudo[110988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.info Jun 11 05:28:36 devstack sudo[110988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:36 devstack sudo[110985]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.586s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:36 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Deleted volume successfully. Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8c5c8f93-05f5-4aca-a8c5-436fbe1d1596 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-7db4cc80-7549-4704-9f70-508b7daf600d-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-2aa2a85d-a309-4983-9800-2da52ef965ca-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-2aa2a85d-a309-4983-9800-2da52ef965ca-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-quobyte-2aa2a85d-a309-4983-9800-2da52ef965ca" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-2aa2a85d-a309-4983-9800-2da52ef965ca" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09c8738-76a6-4955-87f7-239ed946bafe]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2aa2a85d-a309-4983-9800-2da52ef965ca {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:37 devstack sudo[110991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2aa2a85d-a309-4983-9800-2da52ef965ca Jun 11 05:28:37 devstack sudo[110991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:37 devstack sudo[110988]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.info" returned: 0 in 0.610s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:37 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.info is being set with open permissions: ugo+rw Jun 11 05:28:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:37 devstack sudo[110994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.info Jun 11 05:28:37 devstack sudo[110994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:37 devstack sudo[110991]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2aa2a85d-a309-4983-9800-2da52ef965ca" returned: 0 in 0.698s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2aa2a85d-a309-4983-9800-2da52ef965ca {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:37 devstack sudo[110994]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:37 devstack sudo[111000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2aa2a85d-a309-4983-9800-2da52ef965ca Jun 11 05:28:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.info" returned: 0 in 0.586s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:37 devstack sudo[111000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.023s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:37 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5f3fc1c2-e7cd-4275-916e-f6fe8dbb8694 tempest-VolumeDependencyTests-1758130098 None] Create snapshot completed successfully Jun 11 05:28:38 devstack sudo[111000]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-2aa2a85d-a309-4983-9800-2da52ef965ca" returned: 0 in 0.597s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-2aa2a85d-a309-4983-9800-2da52ef965ca" released by "delete_volume" :: held 1.333s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Created reservations ['8501b673-ccd3-4a98-9c49-e4583df4f43c', '940d2d95-09c4-4070-aa7d-7134d2571e11', '4c56c22b-901b-4620-b3b1-e7053f6322df', '98ac6644-d5f8-44b8-af4f-8bc5068d6738'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:38 devstack sudo[111003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:38 devstack sudo[111003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Flow 'volume_create_manager' (5db51c0f-a37f-4be5-839a-370ec87215fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43812a8-e038-4e9c-9018-53012dc2da51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43812a8-e038-4e9c-9018-53012dc2da51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-374014784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ed193d8be746ac98c69ec9c55eda4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9507ebec-ffb0-4939-85ba-a5d81ab31209,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:39Z,use_quota=True,user_id='0e2ade724f384506a6cebb017ce106c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc238f9-37b7-428a-86f7-96cc1cb8935a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc238f9-37b7-428a-86f7-96cc1cb8935a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d974d7-468d-4c13-bcfd-82224b570faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d974d7-468d-4c13-bcfd-82224b570faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8', 'volume_name': 'volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8', 'volume_size': 1, 'snapshot_id': '9507ebec-ffb0-4939-85ba-a5d81ab31209'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c05ff06-eb7c-450e-9036-86b1a12349be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c05ff06-eb7c-450e-9036-86b1a12349be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79be59b2-7a20-4dfc-a775-35195540095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:38 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Volume cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8', 'volume_size': 1, 'snapshot_id': '9507ebec-ffb0-4939-85ba-a5d81ab31209'} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "cinder-quobyte-9507ebec-ffb0-4939-85ba-a5d81ab31209-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8" by "_create_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-quobyte-9507ebec-ffb0-4939-85ba-a5d81ab31209-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Creating volume cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8 from snapshot 9507ebec-ffb0-4939-85ba-a5d81ab31209 {{(pid=92308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "cinder-quobyte-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8" by "_copy_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-quobyte-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] snapshot: 9507ebec-ffb0-4939-85ba-a5d81ab31209, volume: cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8, {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaa869d-33b6-4c6c-ab5e-e232f791b556]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:39 devstack sudo[111003]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.632s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:39 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Deleted volume successfully. Jun 11 05:28:39 devstack sudo[111006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 Jun 11 05:28:39 devstack sudo[111006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c4122e04-9df0-4a50-bbdf-4f0522781d6e tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-2aa2a85d-a309-4983-9800-2da52ef965ca-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-02f61129-b674-4732-9dac-cea85408be45-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-02f61129-b674-4732-9dac-cea85408be45-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-quobyte-02f61129-b674-4732-9dac-cea85408be45" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-02f61129-b674-4732-9dac-cea85408be45" acquired by "delete_volume" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[414f5fd3-1134-4ed5-9bc6-d99eacf29700]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-02f61129-b674-4732-9dac-cea85408be45 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:39 devstack sudo[111008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-02f61129-b674-4732-9dac-cea85408be45 Jun 11 05:28:39 devstack sudo[111008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:39 devstack sudo[111006]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209" returned: 0 in 0.734s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbcafeda-9efe-445c-9dba-732b637e2e77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] will copy from snapshot at /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Creating direct copy from snapshot {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[047e27b1-94a0-423e-9f68-efac02aa18ad]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:39 devstack sudo[111013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 Jun 11 05:28:39 devstack sudo[111013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:39 devstack sudo[111008]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-02f61129-b674-4732-9dac-cea85408be45" returned: 0 in 0.742s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-02f61129-b674-4732-9dac-cea85408be45 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:39 devstack sudo[111018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-02f61129-b674-4732-9dac-cea85408be45 Jun 11 05:28:39 devstack sudo[111018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:40 devstack sudo[111013]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77" returned: 0 in 0.697s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG cinder.utils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Path /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8 not found in is_blk_device check {{(pid=92308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:40 devstack sudo[111023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8 Jun 11 05:28:40 devstack sudo[111023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:40 devstack sudo[111018]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-02f61129-b674-4732-9dac-cea85408be45" returned: 0 in 0.619s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-02f61129-b674-4732-9dac-cea85408be45" released by "delete_volume" :: held 1.406s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=100,cinder:INSERT=28,cinder:UPDATE=132,cinder:DELETE=13 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=140,cinder:SELECT=102,cinder:INSERT=32,cinder:DELETE=14 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Created reservations ['8fb89fa0-b28b-4d01-993e-0d42ee455c4d', '12bb2052-a660-4cd9-a399-f29f569e050b', '6c31dc37-3d50-4f76-9c93-987371f331c2', 'd6f3571d-4f53-4e0c-8496-0b65ec539b37'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:40 devstack sudo[111026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:40 devstack sudo[111026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:41 devstack sudo[111026]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.804s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:41 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:41 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Deleted volume successfully. Jun 11 05:28:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5f864819-dd4e-4ab0-b86d-9a534eba0b8f tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-02f61129-b674-4732-9dac-cea85408be45-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-quobyte-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd" acquired by "delete_volume" :: waited 0.035s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:41 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aac800-ad43-4d32-9a51-ffca0b3f9d54]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:41 devstack sudo[111039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd Jun 11 05:28:41 devstack sudo[111039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:43 devstack sudo[111039]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd" returned: 0 in 1.464s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:43 devstack sudo[111045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd Jun 11 05:28:43 devstack sudo[111045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:44 devstack sudo[111045]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd" returned: 0 in 1.236s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:44 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd" released by "delete_volume" :: held 2.789s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:44 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Created reservations ['d3549c30-12dc-478d-9cda-0b4bb61b5ca4', '2fee1b2c-546e-4700-a634-d352fe60242f', 'bece0d12-f7f7-4b08-a567-2cb60d13d558', '3cca698e-d65b-4f9b-a0c4-ba3083881c70'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:44 devstack sudo[111049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:44 devstack sudo[111049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-1073e101-0f25-477c-8935-3584812deffb-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-1073e101-0f25-477c-8935-3584812deffb-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-quobyte-1073e101-0f25-477c-8935-3584812deffb" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-1073e101-0f25-477c-8935-3584812deffb" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:45 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5714c2d-af43-4a8c-b977-2a201c457e87]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1073e101-0f25-477c-8935-3584812deffb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:45 devstack sudo[111023]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8" returned: 0 in 5.016s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:45 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11d9519-356f-493d-a349-9b04c7cf9e70]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:45 devstack sudo[111051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1073e101-0f25-477c-8935-3584812deffb Jun 11 05:28:45 devstack sudo[111051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:45 devstack sudo[111052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 Jun 11 05:28:45 devstack sudo[111052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:45 devstack sudo[111049]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.024s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:45 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:45 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Deleted volume successfully. Jun 11 05:28:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2cfbef54-8c77-4608-bf17-842905365850 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-8ae8162c-f0c7-4d0a-b8e4-ed1f82bec6cd-delete_volume" released by "delete_volume" :: held 4.250s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:46 devstack sudo[111051]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1073e101-0f25-477c-8935-3584812deffb" returned: 0 in 0.743s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1073e101-0f25-477c-8935-3584812deffb {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:46 devstack sudo[111061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1073e101-0f25-477c-8935-3584812deffb Jun 11 05:28:46 devstack sudo[111061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:46 devstack sudo[111052]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77" returned: 0 in 0.891s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8 {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:28:46 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Converted 1024.00 MB image at 204.08 MB/s Jun 11 05:28:46 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8 is being set with open permissions: ugo+rw Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:46 devstack sudo[111064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8 Jun 11 05:28:46 devstack sudo[111064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:46 devstack sudo[111061]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1073e101-0f25-477c-8935-3584812deffb" returned: 0 in 0.592s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-1073e101-0f25-477c-8935-3584812deffb" released by "delete_volume" :: held 1.385s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Created reservations ['33267c52-8e90-4585-aa04-a790b9eb0b52', 'e9e16986-72fa-4aee-a3b8-98e670517032', 'a114901a-04f2-4ea2-a451-1d6f89863634', '630f7ee0-5c46-44c0-90af-d352ac90717a'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:46 devstack sudo[111068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:46 devstack sudo[111068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:46 devstack sudo[111064]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8" returned: 0 in 0.585s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-quobyte-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8" released by "_copy_volume_from_snapshot" :: held 8.014s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-quobyte-9507ebec-ffb0-4939-85ba-a5d81ab31209-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8" released by "_create_volume_from_snapshot" :: held 8.044s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.061s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79be59b2-7a20-4dfc-a775-35195540095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8', 'volume_size': 1, 'snapshot_id': '9507ebec-ffb0-4939-85ba-a5d81ab31209'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834604cf-079f-41a0-9d23-d56c384a033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:46 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Volume volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8 (cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8): created successfully Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834604cf-079f-41a0-9d23-d56c384a033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Flow 'volume_create_manager' (5db51c0f-a37f-4be5-839a-370ec87215fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:46 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5444795d-d66c-4442-a51e-bd70a805a2bc tempest-VolumeDependencyTests-1758130098 None] Created volume successfully. Jun 11 05:28:47 devstack sudo[111068]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.579s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:47 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Deleted volume successfully. Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-db6ada26-65fb-4f28-afd7-523675bd31ba tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-1073e101-0f25-477c-8935-3584812deffb-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-9e466f9d-a422-401c-9425-46f4ccc7ad90-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-9e466f9d-a422-401c-9425-46f4ccc7ad90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-quobyte-66a745c8-b759-48ce-954f-6b088349a178" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-66a745c8-b759-48ce-954f-6b088349a178" acquired by "delete_snapshot" :: waited 0.013s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-quobyte-9e466f9d-a422-401c-9425-46f4ccc7ad90" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-9e466f9d-a422-401c-9425-46f4ccc7ad90" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Deleting offline snapshot 9e466f9d-a422-401c-9425-46f4ccc7ad90 of volume 66a745c8-b759-48ce-954f-6b088349a178 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] snapshot_file for this snap is: volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8822e0a-a323-496f-b332-4d440cb41154]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:47 devstack sudo[111071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 Jun 11 05:28:47 devstack sudo[111071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "cinder-9507ebec-ffb0-4939-85ba-a5d81ab31209-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-9507ebec-ffb0-4939-85ba-a5d81ab31209-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "cinder-quobyte-cbcafeda-9efe-445c-9dba-732b637e2e77" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-quobyte-cbcafeda-9efe-445c-9dba-732b637e2e77" acquired by "delete_snapshot" :: waited 0.013s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "cinder-quobyte-9507ebec-ffb0-4939-85ba-a5d81ab31209" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-quobyte-9507ebec-ffb0-4939-85ba-a5d81ab31209" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Deleting offline snapshot 9507ebec-ffb0-4939-85ba-a5d81ab31209 of volume cbcafeda-9efe-445c-9dba-732b637e2e77 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] snapshot_file for this snap is: volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af6bd9b-c2ec-462b-9b1f-d29819791dc8]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:47 devstack sudo[111073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 Jun 11 05:28:47 devstack sudo[111073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:48 devstack sudo[111071]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90" returned: 0 in 0.710s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66a745c8-b759-48ce-954f-6b088349a178(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:28:48 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc344c21-193c-42e5-b8a6-1e1a6b0de8a2]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:48 devstack sudo[111078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178 Jun 11 05:28:48 devstack sudo[111078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:48 devstack sudo[111073]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209" returned: 0 in 0.724s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:48 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbcafeda-9efe-445c-9dba-732b637e2e77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:28:48 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca54f1e7-8e7c-472f-a759-c0a6ce6ab7e7]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:48 devstack sudo[111083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 Jun 11 05:28:48 devstack sudo[111083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:48 devstack sudo[111078]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178" returned: 0 in 0.711s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:49 devstack sudo[111088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 Jun 11 05:28:49 devstack sudo[111088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:49 devstack sudo[111083]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77" returned: 0 in 0.726s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:49 devstack sudo[111093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 Jun 11 05:28:49 devstack sudo[111093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:49 devstack sudo[111088]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90" returned: 0 in 0.701s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:49 devstack sudo[111098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90 Jun 11 05:28:49 devstack sudo[111098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:49 devstack sudo[111093]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209" returned: 0 in 0.707s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:50 devstack sudo[111103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209 Jun 11 05:28:50 devstack sudo[111103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:50 devstack sudo[111098]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178.9e466f9d-a422-401c-9425-46f4ccc7ad90" returned: 0 in 0.656s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-9e466f9d-a422-401c-9425-46f4ccc7ad90" released by "_delete_snapshot" :: held 2.880s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-66a745c8-b759-48ce-954f-6b088349a178" released by "delete_snapshot" :: held 2.902s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Created reservations ['e9ecd90b-4c7e-4a31-8219-fe8fbd1c9204', 'c1bdcc53-284e-4899-b4a8-73afda5b67ac', 'bbbda87d-fde8-4518-83d3-db6368346d8b', '5d4f3a2c-8226-4737-a6d5-e8e16888edee'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:50 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Delete snapshot completed successfully. Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-62495bb1-7490-4a02-a873-b5b427e5b8e2 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-9e466f9d-a422-401c-9425-46f4ccc7ad90-delete_snapshot" released by "delete_snapshot" :: held 3.075s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:50 devstack sudo[111103]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77.9507ebec-ffb0-4939-85ba-a5d81ab31209" returned: 0 in 0.600s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-quobyte-9507ebec-ffb0-4939-85ba-a5d81ab31209" released by "_delete_snapshot" :: held 2.855s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-66a745c8-b759-48ce-954f-6b088349a178-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-quobyte-cbcafeda-9efe-445c-9dba-732b637e2e77" released by "delete_snapshot" :: held 2.886s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-66a745c8-b759-48ce-954f-6b088349a178-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "cinder-quobyte-66a745c8-b759-48ce-954f-6b088349a178" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-66a745c8-b759-48ce-954f-6b088349a178" acquired by "delete_volume" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Created reservations ['e828eec7-95db-42c2-8f55-411f01341c40', 'c6fdac3d-3828-4e2f-9074-3033bdeee96e', '290d8c55-6548-44ab-8896-a64799a3f8b7', 'fa8f4b07-d065-4a54-a5d0-3b09d1992d47'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f02057-cc31-43be-bb07-c54cd6eb1cbe]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:50 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Delete snapshot completed successfully. Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cd633798-acfe-4871-a1a6-159b0d6706b0 tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-9507ebec-ffb0-4939-85ba-a5d81ab31209-delete_snapshot" released by "delete_snapshot" :: held 3.081s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:50 devstack sudo[111107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178 Jun 11 05:28:50 devstack sudo[111107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "cinder-cbcafeda-9efe-445c-9dba-732b637e2e77-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-cbcafeda-9efe-445c-9dba-732b637e2e77-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "cinder-quobyte-cbcafeda-9efe-445c-9dba-732b637e2e77" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-quobyte-cbcafeda-9efe-445c-9dba-732b637e2e77" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:51 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c1e88c-61b0-44a2-9fa6-8de91178a3c8]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:51 devstack sudo[111109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 Jun 11 05:28:51 devstack sudo[111109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:51 devstack sudo[111107]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178" returned: 0 in 0.772s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:51 devstack sudo[111115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178 Jun 11 05:28:51 devstack sudo[111115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:51 devstack sudo[111109]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77" returned: 0 in 0.718s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:51 devstack sudo[111120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77 Jun 11 05:28:51 devstack sudo[111120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:52 devstack sudo[111115]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-66a745c8-b759-48ce-954f-6b088349a178" returned: 0 in 0.619s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-quobyte-66a745c8-b759-48ce-954f-6b088349a178" released by "delete_volume" :: held 1.451s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Created reservations ['80796d7b-1330-4f8b-8e51-ae1f2024b432', 'c17d4b8a-64b3-4443-b786-bb8220ec3f2e', 'a8a4b8bf-d16a-4bc4-ba17-39b262cabc0b', 'a743e874-914a-41ca-afc2-7ade20d73f1d'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:52 devstack sudo[111125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:52 devstack sudo[111125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:52 devstack sudo[111120]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cbcafeda-9efe-445c-9dba-732b637e2e77" returned: 0 in 0.637s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-quobyte-cbcafeda-9efe-445c-9dba-732b637e2e77" released by "delete_volume" :: held 1.411s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Created reservations ['b0071c8d-7581-464c-befd-83761ba8663a', '9ad74a62-4d6c-4101-be69-4b139864c385', '83ca0f60-216e-47ce-b5c9-a315270213ff', '4aa78414-e019-4826-a649-ae640a232d97'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:52 devstack sudo[111127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:52 devstack sudo[111127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:52 devstack sudo[111125]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.615s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:52 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Deleted volume successfully. Jun 11 05:28:52 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1ca491f0-18d9-41e1-941b-a0ae72f755c5 tempest-CreateVolumesFromSnapshotTest-1437967209 None] Lock "cinder-66a745c8-b759-48ce-954f-6b088349a178-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:53 devstack sudo[111127]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "cinder-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.663s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:53 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:53 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Deleted volume successfully. Jun 11 05:28:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-02589b8c-dc5d-4595-aaa5-db8a95b86c2e tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-cbcafeda-9efe-445c-9dba-732b637e2e77-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "cinder-quobyte-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:28:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-quobyte-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8" acquired by "delete_volume" :: waited 0.017s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:28:53 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ff9f52-1956-4291-9300-706c10334ad4]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:28:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:53 devstack sudo[111131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8 Jun 11 05:28:53 devstack sudo[111131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:54 devstack sudo[111131]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8" returned: 0 in 0.717s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:54 devstack sudo[111137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8 Jun 11 05:28:54 devstack sudo[111137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:54 devstack sudo[111137]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8" returned: 0 in 0.629s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-quobyte-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8" released by "delete_volume" :: held 1.389s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:54 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Created reservations ['e5fee918-1135-4aee-addf-bc9d2c6383d0', '3930bfd9-0a2d-45a2-aa13-9879c63ae369', '9a46e130-dd24-4a46-a9c2-17c33cbe1da0', 'a72b480a-29a2-4902-93d1-637536d49852'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:28:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:54 devstack sudo[111141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:28:54 devstack sudo[111141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:55 devstack sudo[111141]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.578s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:55 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:28:55 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Deleted volume successfully. Jun 11 05:28:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b79ffe9e-7744-43e7-9e47-6c8f32a367da tempest-VolumeDependencyTests-1758130098 None] Lock "cinder-cb23053b-fcb3-438d-a1d2-b9bb3cfe78d8-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Flow 'volume_create_manager' (b76ed0a1-05b7-4b8e-9253-d7c8f4dd6bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005d4c9e-43ca-4955-8f55-31ad5d56248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005d4c9e-43ca-4955-8f55-31ad5d56248f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9496e395-98ca-4ec1-8bb4-145f71c376f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa3f0ced35847dfa901115fe42ac37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:58Z,use_quota=True,user_id='b1c946410c8244e783ca7f5c4a2ac5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1238492-8d3f-4466-b96f-84a8c232f2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1238492-8d3f-4466-b96f-84a8c232f2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16c9bbb-822c-4882-801f-cb7a8d8538fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16c9bbb-822c-4882-801f-cb7a8d8538fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9496e395-98ca-4ec1-8bb4-145f71c376f5', 'volume_name': 'volume-9496e395-98ca-4ec1-8bb4-145f71c376f5', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7727fa23-b10e-4c36-86cd-53b2cf976b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7727fa23-b10e-4c36-86cd-53b2cf976b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa85f34-2054-43af-826c-e614a89a4537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:57 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Volume 9496e395-98ca-4ec1-8bb4-145f71c376f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9496e395-98ca-4ec1-8bb4-145f71c376f5', 'volume_size': 1} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9496e395-98ca-4ec1-8bb4-145f71c376f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa3f0ced35847dfa901115fe42ac37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:28:58Z,use_quota=True,user_id='b1c946410c8244e783ca7f5c4a2ac5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Creating volume 9496e395-98ca-4ec1-8bb4-145f71c376f5 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:28:57 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:28:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-9496e395-98ca-4ec1-8bb4-145f71c376f5 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:58 devstack sudo[111144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-9496e395-98ca-4ec1-8bb4-145f71c376f5 1073741824 Jun 11 05:28:58 devstack sudo[111144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:58 devstack sudo[111144]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-9496e395-98ca-4ec1-8bb4-145f71c376f5 1073741824" returned: 0 in 0.746s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-9496e395-98ca-4ec1-8bb4-145f71c376f5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:28:58 devstack sudo[111149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-9496e395-98ca-4ec1-8bb4-145f71c376f5 Jun 11 05:28:58 devstack sudo[111149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:28:59 devstack sudo[111149]: pam_unix(sudo:session): session closed for user root Jun 11 05:28:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-9496e395-98ca-4ec1-8bb4-145f71c376f5" returned: 0 in 0.596s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:28:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:28:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:28:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa85f34-2054-43af-826c-e614a89a4537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9496e395-98ca-4ec1-8bb4-145f71c376f5', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094e2341-6b9f-4697-9d67-dde8c4bfed7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:28:59 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Volume volume-9496e395-98ca-4ec1-8bb4-145f71c376f5 (9496e395-98ca-4ec1-8bb4-145f71c376f5): created successfully Jun 11 05:28:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094e2341-6b9f-4697-9d67-dde8c4bfed7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:28:59 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Flow 'volume_create_manager' (b76ed0a1-05b7-4b8e-9253-d7c8f4dd6bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:28:59 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-1d44bbf7-dd6a-412f-a836-491ba26c7fc9 tempest-CinderUnicodeTest-1822809969 None] Created volume successfully. Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Flow 'volume_create_manager' (38527605-5742-4339-abfc-6287487577d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6556ce2-dfd9-40dc-af8d-9cbfffcdfa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6556ce2-dfd9-40dc-af8d-9cbfffcdfa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:29:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2068452907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa3f0ced35847dfa901115fe42ac37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:29:00Z,use_quota=True,user_id='b1c946410c8244e783ca7f5c4a2ac5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d233b6be-1017-40a3-b5e3-6ac5295c1d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d233b6be-1017-40a3-b5e3-6ac5295c1d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d1d08d-15af-4b8e-aa1c-a773a836c425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d1d08d-15af-4b8e-aa1c-a773a836c425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47', 'volume_name': 'volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9c826b-bc05-4fda-92df-2ce124f8df19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9c826b-bc05-4fda-92df-2ce124f8df19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046d3578-8b6b-45da-b94e-c9098cbf3b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:00 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Volume e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47', 'volume_size': 1} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:29:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2068452907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa3f0ced35847dfa901115fe42ac37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:29:00Z,use_quota=True,user_id='b1c946410c8244e783ca7f5c4a2ac5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Creating volume e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:29:00 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:29:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:00 devstack sudo[111153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 1073741824 Jun 11 05:29:00 devstack sudo[111153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:01 devstack sudo[111153]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 1073741824" returned: 0 in 0.749s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:01 devstack sudo[111158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 Jun 11 05:29:01 devstack sudo[111158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:01 devstack sudo[111158]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47" returned: 0 in 0.579s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:29:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046d3578-8b6b-45da-b94e-c9098cbf3b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6db235-e8cf-4480-a66f-7d9a0bcc58f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:01 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Volume volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 (e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47): created successfully Jun 11 05:29:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6db235-e8cf-4480-a66f-7d9a0bcc58f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:01 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Flow 'volume_create_manager' (38527605-5742-4339-abfc-6287487577d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:29:01 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-75cde209-a8e4-4372-b56f-9159c024b4ca tempest-CinderUnicodeTest-1822809969 None] Created volume successfully. Jun 11 05:29:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] Creating offline snapshot 88a82a8d-f0ea-49aa-a6bd-105b107d1de7 of volume e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:29:02 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dcedc8-ec16-4082-a2c6-b04b1c0eb628]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:29:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:02 devstack sudo[111161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 Jun 11 05:29:02 devstack sudo[111161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:03 devstack sudo[111161]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47" returned: 0 in 0.694s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:03 devstack sudo[111166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 1G Jun 11 05:29:03 devstack sudo[111166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:04 devstack sudo[111166]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 1G" returned: 0 in 0.724s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:04 devstack sudo[111178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 Jun 11 05:29:04 devstack sudo[111178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:04 devstack sudo[111178]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7" returned: 0 in 0.611s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:04 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 is being set with open permissions: ugo+rw Jun 11 05:29:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:04 devstack sudo[111185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 Jun 11 05:29:04 devstack sudo[111185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:05 devstack sudo[111185]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7" returned: 0 in 0.578s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:05 devstack sudo[111188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.info Jun 11 05:29:05 devstack sudo[111188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:05 devstack sudo[111188]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.info" returned: 0 in 0.579s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:05 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.info is being set with open permissions: ugo+rw Jun 11 05:29:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:06 devstack sudo[111191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.info Jun 11 05:29:06 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:06 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.info" returned: 0 in 0.573s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.841s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:06 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8d88ab4f-19aa-4458-93d8-6a13f37a64d2 tempest-CinderUnicodeTest-1822809969 None] Create snapshot completed successfully Jun 11 05:29:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "cinder-88a82a8d-f0ea-49aa-a6bd-105b107d1de7-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-88a82a8d-f0ea-49aa-a6bd-105b107d1de7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "cinder-quobyte-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-quobyte-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "cinder-quobyte-88a82a8d-f0ea-49aa-a6bd-105b107d1de7" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:06 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-quobyte-88a82a8d-f0ea-49aa-a6bd-105b107d1de7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Deleting offline snapshot 88a82a8d-f0ea-49aa-a6bd-105b107d1de7 of volume e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:29:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] snapshot_file for this snap is: volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:29:07 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4f2e7a-b0c5-495b-a075-78cfaa61b6a6]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:29:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:07 devstack sudo[111194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 Jun 11 05:29:07 devstack sudo[111194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:07 devstack sudo[111194]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7" returned: 0 in 0.709s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:29:07 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[471ee76e-3af1-4459-9b25-327a5b01fbdb]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:29:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:07 devstack sudo[111199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 Jun 11 05:29:07 devstack sudo[111199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:08 devstack sudo[111199]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47" returned: 0 in 0.689s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:08 devstack sudo[111204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 Jun 11 05:29:08 devstack sudo[111204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:09 devstack sudo[111204]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7" returned: 0 in 0.663s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:09 devstack sudo[111209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7 Jun 11 05:29:09 devstack sudo[111209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:09 devstack sudo[111209]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47.88a82a8d-f0ea-49aa-a6bd-105b107d1de7" returned: 0 in 0.579s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-quobyte-88a82a8d-f0ea-49aa-a6bd-105b107d1de7" released by "_delete_snapshot" :: held 2.732s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-quobyte-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47" released by "delete_snapshot" :: held 2.752s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:09 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Created reservations ['3b098229-9c59-4e33-8b12-c16b77305190', '4849fa42-0012-457c-91a6-b4068f11a50d', '0b94cab4-ca67-4670-9dbe-b0e901c81c55', 'b3f9cbb4-ad43-4f8c-8015-026f4bbcf11a'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:29:09 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Delete snapshot completed successfully. Jun 11 05:29:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0ee26c61-342b-475b-86f8-6ce3a0d0ae8c tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-88a82a8d-f0ea-49aa-a6bd-105b107d1de7-delete_snapshot" released by "delete_snapshot" :: held 2.875s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "cinder-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "cinder-quobyte-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-quobyte-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47" acquired by "delete_volume" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:10 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffaa531-6308-472f-99fd-46adf68363b7]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:29:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:10 devstack sudo[111212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 Jun 11 05:29:10 devstack sudo[111212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:10 devstack sudo[111212]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47" returned: 0 in 0.715s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:10 devstack sudo[111217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47 Jun 11 05:29:10 devstack sudo[111217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:11 devstack sudo[111217]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47" returned: 0 in 0.584s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:11 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-quobyte-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47" released by "delete_volume" :: held 1.358s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:11 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Created reservations ['d787791d-b8bc-4b8b-85e2-2e1abcbe9612', '61a63948-8524-4ec2-8915-e65c268d3886', 'e91b1556-75a8-4aaf-b608-d3eca1287a1d', 'bba9bfcb-554d-42e6-95ca-a369404296c9'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:29:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:29:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:29:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:11 devstack sudo[111220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:29:11 devstack sudo[111220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:12 devstack sudo[111220]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.594s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:12 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:29:12 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Deleted volume successfully. Jun 11 05:29:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-0a0fa451-1ed1-4172-ad85-f128392bbbb7 tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-e81aaf9a-8ca5-4e6d-a4f5-75f7a5985a47-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "cinder-9496e395-98ca-4ec1-8bb4-145f71c376f5-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-9496e395-98ca-4ec1-8bb4-145f71c376f5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "cinder-quobyte-9496e395-98ca-4ec1-8bb4-145f71c376f5" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:12 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-quobyte-9496e395-98ca-4ec1-8bb4-145f71c376f5" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:12 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7ab04e-c902-4408-84e3-ba80187b4c29]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:29:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-9496e395-98ca-4ec1-8bb4-145f71c376f5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:12 devstack sudo[111223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-9496e395-98ca-4ec1-8bb4-145f71c376f5 Jun 11 05:29:12 devstack sudo[111223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:13 devstack sudo[111223]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-9496e395-98ca-4ec1-8bb4-145f71c376f5" returned: 0 in 0.707s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-9496e395-98ca-4ec1-8bb4-145f71c376f5 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:13 devstack sudo[111228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-9496e395-98ca-4ec1-8bb4-145f71c376f5 Jun 11 05:29:13 devstack sudo[111228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:13 devstack sudo[111228]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-9496e395-98ca-4ec1-8bb4-145f71c376f5" returned: 0 in 0.605s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:13 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-quobyte-9496e395-98ca-4ec1-8bb4-145f71c376f5" released by "delete_volume" :: held 1.350s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:14 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Created reservations ['f5009f6c-face-49f7-a103-aacc2936b46f', '0d491faa-a24c-4637-ac07-a7cbd3d609a4', '3f8c927d-46df-44b1-b899-44316c96d5a6', 'd11c1283-c393-4bde-a60d-ad607e4f841c'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:29:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:29:14 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:29:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:14 devstack sudo[111232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:29:14 devstack sudo[111232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:14 devstack sudo[111232]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.585s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:14 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:29:14 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Deleted volume successfully. Jun 11 05:29:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e8f7832f-5e67-4d78-bead-881e954e6ecd tempest-CinderUnicodeTest-1822809969 None] Lock "cinder-9496e395-98ca-4ec1-8bb4-145f71c376f5-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:24 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=78,cinder:SELECT=64,cinder:INSERT=24,cinder:DELETE=6 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:29:24 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=61,cinder:INSERT=23,cinder:UPDATE=100,cinder:DELETE=6 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:29:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:29:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:29:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:29:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:30 devstack sudo[111275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:29:30 devstack sudo[111275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:30 devstack sudo[111275]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.598s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:30 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:29:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:29:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:29:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Flow 'volume_create_manager' (d6a9b8f1-0108-4722-aff3-2a279fa82709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2c4148-2a3b-4e6c-8624-0639fba96067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2c4148-2a3b-4e6c-8624-0639fba96067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-238127713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecb39ef-e47c-43cd-940d-bb9ac6885b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e45dad92524f2fad5e3a4ce06c33fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:29:37Z,use_quota=True,user_id='1bd6b3d3e8ec46b39243bb019b2c0450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced55846-68b7-4347-a0ac-079e6818e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced55846-68b7-4347-a0ac-079e6818e82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2933c00e-bd6f-4303-a523-8da25ca53f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2933c00e-bd6f-4303-a523-8da25ca53f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eecb39ef-e47c-43cd-940d-bb9ac6885b42', 'volume_name': 'volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe854a9-0a36-419a-a5d4-b508c1a9e54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe854a9-0a36-419a-a5d4-b508c1a9e54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553e4808-54b1-4bba-94d8-a23aa76dd7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:36 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Volume eecb39ef-e47c-43cd-940d-bb9ac6885b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42', 'volume_size': 1} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-238127713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecb39ef-e47c-43cd-940d-bb9ac6885b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e45dad92524f2fad5e3a4ce06c33fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:29:37Z,use_quota=True,user_id='1bd6b3d3e8ec46b39243bb019b2c0450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Creating volume eecb39ef-e47c-43cd-940d-bb9ac6885b42 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:29:36 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:29:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:36 devstack sudo[111279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 1073741824 Jun 11 05:29:36 devstack sudo[111279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:37 devstack sudo[111279]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 1073741824" returned: 0 in 0.731s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:37 devstack sudo[111285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 Jun 11 05:29:37 devstack sudo[111285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:38 devstack sudo[111285]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42" returned: 0 in 0.572s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:38 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:29:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553e4808-54b1-4bba-94d8-a23aa76dd7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb997e7-f201-4913-80ee-4cb82035753b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:38 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Volume volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 (eecb39ef-e47c-43cd-940d-bb9ac6885b42): created successfully Jun 11 05:29:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb997e7-f201-4913-80ee-4cb82035753b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:38 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Flow 'volume_create_manager' (d6a9b8f1-0108-4722-aff3-2a279fa82709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:29:38 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5a8a07b6-d23c-483d-939a-a8510d1e71f1 tempest-SnapshotDependencyTests-1390208528 None] Created volume successfully. Jun 11 05:29:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] Creating offline snapshot 5a5f4054-8e99-4422-951d-aa154475178c of volume eecb39ef-e47c-43cd-940d-bb9ac6885b42 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:29:39 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[358f15f9-5e25-4245-85d4-7918c9ea4669]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:29:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:39 devstack sudo[111288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 Jun 11 05:29:39 devstack sudo[111288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:39 devstack sudo[111288]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42" returned: 0 in 0.688s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:39 devstack sudo[111293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c 1G Jun 11 05:29:39 devstack sudo[111293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:40 devstack sudo[111293]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c 1G" returned: 0 in 0.754s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:40 devstack sudo[111298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c Jun 11 05:29:40 devstack sudo[111298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:41 devstack sudo[111298]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c" returned: 0 in 0.667s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:41 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c is being set with open permissions: ugo+rw Jun 11 05:29:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:41 devstack sudo[111303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c Jun 11 05:29:41 devstack sudo[111303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:41 devstack sudo[111303]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c" returned: 0 in 0.560s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:41 devstack sudo[111306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.info Jun 11 05:29:41 devstack sudo[111306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:42 devstack sudo[111306]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.info" returned: 0 in 0.578s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:42 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.info is being set with open permissions: ugo+rw Jun 11 05:29:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:42 devstack sudo[111309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.info Jun 11 05:29:42 devstack sudo[111309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:42 devstack sudo[111309]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.info" returned: 0 in 0.579s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.906s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:42 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3417d1b5-4278-4816-a428-1e36fcb83740 tempest-SnapshotDependencyTests-1390208528 None] Create snapshot completed successfully Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Flow 'volume_create_manager' (2ba36f4a-0085-480d-a165-df256580931c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521784bb-77fb-4111-8df0-d0c0988a654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521784bb-77fb-4111-8df0-d0c0988a654e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa78669f-4c54-4545-b4f8-12cacb94cd1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e45dad92524f2fad5e3a4ce06c33fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5a5f4054-8e99-4422-951d-aa154475178c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:29:44Z,use_quota=True,user_id='1bd6b3d3e8ec46b39243bb019b2c0450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70ac641-ed1a-4e90-b1e9-239551a992ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70ac641-ed1a-4e90-b1e9-239551a992ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721dbdcf-0741-432a-9c97-80e94b78751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721dbdcf-0741-432a-9c97-80e94b78751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa78669f-4c54-4545-b4f8-12cacb94cd1c', 'volume_name': 'volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c', 'volume_size': 1, 'snapshot_id': '5a5f4054-8e99-4422-951d-aa154475178c'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d5f835-4ca6-4885-ba40-80d10dd3ce23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d5f835-4ca6-4885-ba40-80d10dd3ce23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea348be-a1a8-4f26-a0be-d9260b5bb402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:43 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Volume aa78669f-4c54-4545-b4f8-12cacb94cd1c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c', 'volume_size': 1, 'snapshot_id': '5a5f4054-8e99-4422-951d-aa154475178c'} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "cinder-quobyte-5a5f4054-8e99-4422-951d-aa154475178c-aa78669f-4c54-4545-b4f8-12cacb94cd1c" by "_create_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-quobyte-5a5f4054-8e99-4422-951d-aa154475178c-aa78669f-4c54-4545-b4f8-12cacb94cd1c" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Creating volume aa78669f-4c54-4545-b4f8-12cacb94cd1c from snapshot 5a5f4054-8e99-4422-951d-aa154475178c {{(pid=92308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "cinder-quobyte-aa78669f-4c54-4545-b4f8-12cacb94cd1c" by "_copy_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-quobyte-aa78669f-4c54-4545-b4f8-12cacb94cd1c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] snapshot: 5a5f4054-8e99-4422-951d-aa154475178c, volume: aa78669f-4c54-4545-b4f8-12cacb94cd1c, {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c30820-042d-4f30-bb59-9f8ba11130df]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:29:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:43 devstack sudo[111312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c Jun 11 05:29:43 devstack sudo[111312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:44 devstack sudo[111312]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c" returned: 0 in 0.684s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:29:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] will copy from snapshot at /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 11 05:29:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Creating direct copy from snapshot {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 11 05:29:44 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eec3d0-9779-4611-8524-3a875e42514d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:29:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:44 devstack sudo[111318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 Jun 11 05:29:44 devstack sudo[111318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:45 devstack sudo[111318]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42" returned: 0 in 0.694s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:45 devstack cinder-volume[92308]: DEBUG cinder.utils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Path /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c not found in is_blk_device check {{(pid=92308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 11 05:29:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:45 devstack sudo[111323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c Jun 11 05:29:45 devstack sudo[111323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:49 devstack sudo[111323]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c" returned: 0 in 4.393s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:49 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b887390-5a2b-4cfe-8cae-5dd21adccc5d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:29:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:49 devstack sudo[111336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 Jun 11 05:29:49 devstack sudo[111336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:50 devstack sudo[111336]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42" returned: 0 in 0.874s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:50 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:29:50 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Converted 1024.00 MB image at 233.04 MB/s Jun 11 05:29:50 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c is being set with open permissions: ugo+rw Jun 11 05:29:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:50 devstack sudo[111341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c Jun 11 05:29:50 devstack sudo[111341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:51 devstack sudo[111341]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c" returned: 0 in 0.574s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-quobyte-aa78669f-4c54-4545-b4f8-12cacb94cd1c" released by "_copy_volume_from_snapshot" :: held 7.298s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-quobyte-5a5f4054-8e99-4422-951d-aa154475178c-aa78669f-4c54-4545-b4f8-12cacb94cd1c" released by "_create_volume_from_snapshot" :: held 7.324s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.337s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea348be-a1a8-4f26-a0be-d9260b5bb402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c', 'volume_size': 1, 'snapshot_id': '5a5f4054-8e99-4422-951d-aa154475178c'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9e7e6b-8fa5-4a3d-aba5-eb75a17f0fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:29:51 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Volume volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c (aa78669f-4c54-4545-b4f8-12cacb94cd1c): created successfully Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9e7e6b-8fa5-4a3d-aba5-eb75a17f0fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Flow 'volume_create_manager' (2ba36f4a-0085-480d-a165-df256580931c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:29:51 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-37b005dc-82e4-41ab-9f7f-727890f80f9b tempest-SnapshotDependencyTests-1390208528 None] Created volume successfully. Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "cinder-5a5f4054-8e99-4422-951d-aa154475178c-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-5a5f4054-8e99-4422-951d-aa154475178c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "cinder-quobyte-eecb39ef-e47c-43cd-940d-bb9ac6885b42" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-quobyte-eecb39ef-e47c-43cd-940d-bb9ac6885b42" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "cinder-quobyte-5a5f4054-8e99-4422-951d-aa154475178c" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-quobyte-5a5f4054-8e99-4422-951d-aa154475178c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Deleting offline snapshot 5a5f4054-8e99-4422-951d-aa154475178c of volume eecb39ef-e47c-43cd-940d-bb9ac6885b42 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] snapshot_file for this snap is: volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ccdb67-c6f5-4a71-a21c-60d6c8e2a2cd]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:29:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:51 devstack sudo[111344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c Jun 11 05:29:51 devstack sudo[111344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:52 devstack sudo[111344]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c" returned: 0 in 0.677s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:29:52 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d617f6d-141d-469d-9207-da484eccfaa1]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:29:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:52 devstack sudo[111349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 Jun 11 05:29:52 devstack sudo[111349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:52 devstack sudo[111349]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42" returned: 0 in 0.715s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:52 devstack sudo[111355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c Jun 11 05:29:52 devstack sudo[111355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:53 devstack sudo[111355]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c" returned: 0 in 0.680s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:53 devstack sudo[111360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c Jun 11 05:29:53 devstack sudo[111360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:54 devstack sudo[111360]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42.5a5f4054-8e99-4422-951d-aa154475178c" returned: 0 in 0.567s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-quobyte-5a5f4054-8e99-4422-951d-aa154475178c" released by "_delete_snapshot" :: held 2.740s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-quobyte-eecb39ef-e47c-43cd-940d-bb9ac6885b42" released by "delete_snapshot" :: held 2.761s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:54 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Created reservations ['49f5835f-c286-4ebf-846e-d355a36cd428', '22a7424c-362c-481a-b2a3-803b7e5902e0', 'd0509997-f9fd-43d1-8b45-1d583165d716', '09b8bb04-5cee-440e-8774-9a7679272766'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:29:54 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Delete snapshot completed successfully. Jun 11 05:29:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-30405730-043b-4906-8341-e3442aeca200 tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-5a5f4054-8e99-4422-951d-aa154475178c-delete_snapshot" released by "delete_snapshot" :: held 2.884s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "cinder-eecb39ef-e47c-43cd-940d-bb9ac6885b42-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-eecb39ef-e47c-43cd-940d-bb9ac6885b42-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "cinder-quobyte-eecb39ef-e47c-43cd-940d-bb9ac6885b42" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-quobyte-eecb39ef-e47c-43cd-940d-bb9ac6885b42" acquired by "delete_volume" :: waited 0.014s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:54 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6d18e9-fd5f-4480-93ee-f4e88e1032e5]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:29:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:54 devstack sudo[111365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 Jun 11 05:29:54 devstack sudo[111365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:55 devstack sudo[111365]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42" returned: 0 in 0.669s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:55 devstack sudo[111370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42 Jun 11 05:29:55 devstack sudo[111370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:55 devstack sudo[111370]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-eecb39ef-e47c-43cd-940d-bb9ac6885b42" returned: 0 in 0.564s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-quobyte-eecb39ef-e47c-43cd-940d-bb9ac6885b42" released by "delete_volume" :: held 1.288s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:55 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Created reservations ['1ad7b1e4-4668-4be2-ba07-4576d9b75328', '40da6c18-6039-4f0e-accd-d7a74fdc8019', 'd79b6e67-63d2-484b-8571-65a03d6aa879', 'fef40eea-d3a9-419d-b580-b2c6ec8b0037'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:29:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:29:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:29:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:56 devstack sudo[111373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:29:56 devstack sudo[111373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:56 devstack sudo[111373]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.573s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:56 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:29:56 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Deleted volume successfully. Jun 11 05:29:56 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-43552660-0179-4127-946b-a63671c8c449 tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-eecb39ef-e47c-43cd-940d-bb9ac6885b42-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:56 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "cinder-aa78669f-4c54-4545-b4f8-12cacb94cd1c-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:56 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-aa78669f-4c54-4545-b4f8-12cacb94cd1c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:56 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "cinder-quobyte-aa78669f-4c54-4545-b4f8-12cacb94cd1c" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:29:56 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-quobyte-aa78669f-4c54-4545-b4f8-12cacb94cd1c" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:29:56 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5480e7-3678-451f-9bf5-b163ec4ad27d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:29:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:56 devstack sudo[111376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c Jun 11 05:29:56 devstack sudo[111376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:57 devstack sudo[111376]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c" returned: 0 in 0.663s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:57 devstack sudo[111381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c Jun 11 05:29:57 devstack sudo[111381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:58 devstack sudo[111381]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-aa78669f-4c54-4545-b4f8-12cacb94cd1c" returned: 0 in 0.562s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-quobyte-aa78669f-4c54-4545-b4f8-12cacb94cd1c" released by "delete_volume" :: held 1.262s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:29:58 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Created reservations ['8a4258ce-2649-4020-9401-84c9af512ce2', '443e6dc8-1129-4502-8083-e6e7e18c0f6b', '44772dde-74df-4409-a922-f9f6bec4f7e4', 'b22d5bf4-fa71-4e93-aa6b-4e30aa84aac9'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:29:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:29:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:29:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:29:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:29:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:29:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:29:58 devstack sudo[111384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:29:58 devstack sudo[111384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:29:58 devstack sudo[111384]: pam_unix(sudo:session): session closed for user root Jun 11 05:29:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.582s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:29:58 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:29:58 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Deleted volume successfully. Jun 11 05:29:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-6f562b68-fb83-4963-8e97-be6bdefcd0bd tempest-SnapshotDependencyTests-1390208528 None] Lock "cinder-aa78669f-4c54-4545-b4f8-12cacb94cd1c-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:08 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=32,cinder:SELECT=23,cinder:INSERT=7 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:30:08 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:DELETE=5,cinder:INSERT=7 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Flow 'volume_create_manager' (1c4984de-69a1-4c53-81f0-5e080b1981c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f77ea9-6a32-4f08-ab50-047cd4b56796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f77ea9-6a32-4f08-ab50-047cd4b56796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1221331321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4783c0-f78e-452b-8a53-460ee138a916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4ad2497a5748748086629346be0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:17Z,use_quota=True,user_id='349e7d272e954f70a764afabe55fde67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cc8569-6b08-479d-96d2-a4bb7cbbc751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cc8569-6b08-479d-96d2-a4bb7cbbc751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29eed73-66e6-4a81-aac2-32600b7f1584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29eed73-66e6-4a81-aac2-32600b7f1584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c4783c0-f78e-452b-8a53-460ee138a916', 'volume_name': 'volume-1c4783c0-f78e-452b-8a53-460ee138a916', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf02e47-d54b-4613-9bd3-2b14d1773bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf02e47-d54b-4613-9bd3-2b14d1773bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba617a6-c4df-46ff-ae56-30bc486b0631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:17 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume 1c4783c0-f78e-452b-8a53-460ee138a916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c4783c0-f78e-452b-8a53-460ee138a916', 'volume_size': 1} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1221331321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4783c0-f78e-452b-8a53-460ee138a916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4ad2497a5748748086629346be0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:17Z,use_quota=True,user_id='349e7d272e954f70a764afabe55fde67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Creating volume 1c4783c0-f78e-452b-8a53-460ee138a916 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:17 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c4783c0-f78e-452b-8a53-460ee138a916 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:17 devstack sudo[111440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c4783c0-f78e-452b-8a53-460ee138a916 1073741824 Jun 11 05:30:17 devstack sudo[111440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Flow 'volume_create_manager' (1bc15a98-3c87-4e82-99f7-fbd278a2ecc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8439a9a1-00f8-455b-8c8d-e086329c4be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8439a9a1-00f8-455b-8c8d-e086329c4be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1674540753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1e75f7-5925-4f66-9099-94037e183b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a17c38e90246efa1819939614a81b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:18Z,use_quota=True,user_id='659004fffbcc4f7d8f709c064a04c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b49d4af-7271-46a2-9d77-17fdc3e98b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b49d4af-7271-46a2-9d77-17fdc3e98b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444fca33-6bd7-4c13-8374-407c2661d471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444fca33-6bd7-4c13-8374-407c2661d471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1e75f7-5925-4f66-9099-94037e183b1a', 'volume_name': 'volume-bd1e75f7-5925-4f66-9099-94037e183b1a', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a742496-8680-4d6d-8c1d-195020cd8a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a742496-8680-4d6d-8c1d-195020cd8a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fbb895-640b-4c56-aa97-d937a51f159b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:17 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume bd1e75f7-5925-4f66-9099-94037e183b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1e75f7-5925-4f66-9099-94037e183b1a', 'volume_size': 1} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:17 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Flow 'volume_create_manager' (4f6d40e7-5eda-415e-ac04-bb3d0a7a2714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c168e8cf-b74f-44a4-bef2-6a48be45f602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c168e8cf-b74f-44a4-bef2-6a48be45f602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1207794115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9458366-f2bd-4c18-a19c-f19c113408f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505dfef567c4402eb600861fcb60aa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:18Z,use_quota=True,user_id='c26f50c1db13423eb3914f128f9a5771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919d3ee8-8a21-4368-b6a0-317ec574ec59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919d3ee8-8a21-4368-b6a0-317ec574ec59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4185f4f7-c529-45bc-9947-b004bad3b591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4185f4f7-c529-45bc-9947-b004bad3b591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9458366-f2bd-4c18-a19c-f19c113408f9', 'volume_name': 'volume-c9458366-f2bd-4c18-a19c-f19c113408f9', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161d70e6-3bc9-4fc2-b075-0407b6587a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161d70e6-3bc9-4fc2-b075-0407b6587a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093b3486-1ccd-40ca-b21c-aa830f8b2f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:18 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Volume c9458366-f2bd-4c18-a19c-f19c113408f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9458366-f2bd-4c18-a19c-f19c113408f9', 'volume_size': 1} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Flow 'volume_create_manager' (27056c82-aa68-40b0-ad0f-44916616093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec161a2-8726-414a-a294-a7c2e80e56d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec161a2-8726-414a-a294-a7c2e80e56d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-582145064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493a67c0-4a84-4ba3-8652-8015981b16df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505dfef567c4402eb600861fcb60aa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:18Z,use_quota=True,user_id='c26f50c1db13423eb3914f128f9a5771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8931f25a-2895-4a66-8146-47e32f428ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8931f25a-2895-4a66-8146-47e32f428ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ce5e83-058d-48c5-80f8-0b27927ca38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:18 devstack sudo[111440]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ce5e83-058d-48c5-80f8-0b27927ca38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '493a67c0-4a84-4ba3-8652-8015981b16df', 'volume_name': 'volume-493a67c0-4a84-4ba3-8652-8015981b16df', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (953ece21-86d6-4451-8800-e6fc3d161f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (953ece21-86d6-4451-8800-e6fc3d161f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e80ac3-59ff-465a-a571-6fa98fc1ccec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:18 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Volume 493a67c0-4a84-4ba3-8652-8015981b16df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-493a67c0-4a84-4ba3-8652-8015981b16df', 'volume_size': 1} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c4783c0-f78e-452b-8a53-460ee138a916 1073741824" returned: 0 in 1.186s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c4783c0-f78e-452b-8a53-460ee138a916 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:18 devstack sudo[111484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c4783c0-f78e-452b-8a53-460ee138a916 Jun 11 05:30:18 devstack sudo[111484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Flow 'volume_create_manager' (6b34edc8-6114-4af9-a030-641c0af7ecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02585d3c-e617-493e-9035-32b00644cf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02585d3c-e617-493e-9035-32b00644cf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-907082387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d950bf-8a58-413d-88de-a358494e11b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505dfef567c4402eb600861fcb60aa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:19Z,use_quota=True,user_id='c26f50c1db13423eb3914f128f9a5771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86732ff7-5d6a-4872-9f71-88d3630f4154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86732ff7-5d6a-4872-9f71-88d3630f4154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056df981-3376-4b43-95ec-9bb62ffbc180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056df981-3376-4b43-95ec-9bb62ffbc180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1d950bf-8a58-413d-88de-a358494e11b9', 'volume_name': 'volume-d1d950bf-8a58-413d-88de-a358494e11b9', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bbf201-602e-4fba-9212-ba0a3563f0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bbf201-602e-4fba-9212-ba0a3563f0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a407ff8-6842-4e06-93d1-6c768b4cc9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Volume d1d950bf-8a58-413d-88de-a358494e11b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1d950bf-8a58-413d-88de-a358494e11b9', 'volume_size': 1} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Flow 'volume_create_manager' (f1d6737a-b1aa-4c05-a9d6-f1041ad02e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72f1e6d-52d3-4a5b-b415-87d2763d6431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72f1e6d-52d3-4a5b-b415-87d2763d6431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560305391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c877bdc-bbde-49e2-8a2c-616e6873d883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505dfef567c4402eb600861fcb60aa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:19Z,use_quota=True,user_id='c26f50c1db13423eb3914f128f9a5771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d147a12f-375a-41fa-98a8-f3a2bfa529f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d147a12f-375a-41fa-98a8-f3a2bfa529f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61198c2d-f42e-4660-ad30-6ff81dcbe8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61198c2d-f42e-4660-ad30-6ff81dcbe8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c877bdc-bbde-49e2-8a2c-616e6873d883', 'volume_name': 'volume-0c877bdc-bbde-49e2-8a2c-616e6873d883', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c93c7f57-f393-4738-99d2-468f4718ba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c93c7f57-f393-4738-99d2-468f4718ba46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3921235-5c62-4c67-907a-b7d091fddc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Volume 0c877bdc-bbde-49e2-8a2c-616e6873d883: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c877bdc-bbde-49e2-8a2c-616e6873d883', 'volume_size': 1} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:19 devstack sudo[111484]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c4783c0-f78e-452b-8a53-460ee138a916" returned: 0 in 0.823s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.655s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1674540753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1e75f7-5925-4f66-9099-94037e183b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a17c38e90246efa1819939614a81b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:18Z,use_quota=True,user_id='659004fffbcc4f7d8f709c064a04c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Creating volume bd1e75f7-5925-4f66-9099-94037e183b1a {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:19 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba617a6-c4df-46ff-ae56-30bc486b0631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c4783c0-f78e-452b-8a53-460ee138a916', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack sudo[111487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a 1073741824 Jun 11 05:30:19 devstack sudo[111487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac88a2a-292b-4155-9e06-1cde0de6f639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume volume-1c4783c0-f78e-452b-8a53-460ee138a916 (1c4783c0-f78e-452b-8a53-460ee138a916): created successfully Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac88a2a-292b-4155-9e06-1cde0de6f639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Flow 'volume_create_manager' (1c4984de-69a1-4c53-81f0-5e080b1981c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:19 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e3bc1344-f059-4915-a648-3c3b4af790fe tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Created volume successfully. Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Flow 'volume_create_manager' (ec790ef6-8b3b-4b92-9219-62a6e92986aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93390aa-7e44-4792-b3db-501b6bcaca6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93390aa-7e44-4792-b3db-501b6bcaca6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-659162984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef79668-3ab9-4568-9e71-d11cd11db45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505dfef567c4402eb600861fcb60aa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:19Z,use_quota=True,user_id='c26f50c1db13423eb3914f128f9a5771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057e717a-1e4d-4315-a7c4-7ca4d72ad2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057e717a-1e4d-4315-a7c4-7ca4d72ad2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbd768e-17cb-4bc1-a479-d14a83fee328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbd768e-17cb-4bc1-a479-d14a83fee328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef79668-3ab9-4568-9e71-d11cd11db45e', 'volume_name': 'volume-0ef79668-3ab9-4568-9e71-d11cd11db45e', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375cd884-3d1d-4704-8abf-36eea9b5beb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375cd884-3d1d-4704-8abf-36eea9b5beb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1dd178-5526-4b18-8486-1f96e6cdacfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:19 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Volume 0ef79668-3ab9-4568-9e71-d11cd11db45e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef79668-3ab9-4568-9e71-d11cd11db45e', 'volume_size': 1} Jun 11 05:30:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Flow 'volume_create_manager' (d68babb3-e706-4ed1-b885-8be5114fdda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c0fc56-77f0-4538-8845-22ea03c87223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c0fc56-77f0-4538-8845-22ea03c87223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794272918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdf6048-b2b7-4072-9d9d-c7b438bb9757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4ad2497a5748748086629346be0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:20Z,use_quota=True,user_id='349e7d272e954f70a764afabe55fde67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d15190c-32cf-4fde-8d91-172adc6ec9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d15190c-32cf-4fde-8d91-172adc6ec9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c904832f-39ef-40c7-bb7d-b032d676e339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c904832f-39ef-40c7-bb7d-b032d676e339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bdf6048-b2b7-4072-9d9d-c7b438bb9757', 'volume_name': 'volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5b9dca-464d-41b7-8089-2d24532cf8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5b9dca-464d-41b7-8089-2d24532cf8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248bcc64-36e9-4194-a297-6a96b732b00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:20 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume 3bdf6048-b2b7-4072-9d9d-c7b438bb9757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757', 'volume_size': 1} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:20 devstack sudo[111487]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a 1073741824" returned: 0 in 0.931s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:20 devstack sudo[111494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a Jun 11 05:30:20 devstack sudo[111494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Flow 'volume_create_manager' (e445a499-2f19-4b4f-9985-6ed8ad0a3079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9367abd8-1c2c-4d11-b39f-e7125e43b602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9367abd8-1c2c-4d11-b39f-e7125e43b602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1698163997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0473633d-36bc-4b4c-b66f-d03ba9827e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4ad2497a5748748086629346be0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:20Z,use_quota=True,user_id='349e7d272e954f70a764afabe55fde67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fa20ac-d489-40c8-9272-7a9462864a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fa20ac-d489-40c8-9272-7a9462864a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d96b5d-3a3a-4041-9a3f-b1fdc643bec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d96b5d-3a3a-4041-9a3f-b1fdc643bec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0473633d-36bc-4b4c-b66f-d03ba9827e4a', 'volume_name': 'volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c38c52e-23c1-416a-a7ed-248748cd772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c38c52e-23c1-416a-a7ed-248748cd772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0d5b7e-24a6-40bf-86d5-3ac09b914a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:20 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume 0473633d-36bc-4b4c-b66f-d03ba9827e4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a', 'volume_size': 1} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:20 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Flow 'volume_create_manager' (2ca87ddd-6b9d-4e34-a28f-634adecae964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfec4d4-0503-4c7e-9567-6bbb27a437e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfec4d4-0503-4c7e-9567-6bbb27a437e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359495064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b522bf-d93a-416d-944d-4e76ef526eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4ad2497a5748748086629346be0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:21Z,use_quota=True,user_id='349e7d272e954f70a764afabe55fde67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:21 devstack sudo[111494]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e1049c-a5cb-42d1-939c-f37fc9cdd9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e1049c-a5cb-42d1-939c-f37fc9cdd9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617e045c-b00f-4294-b12a-476b5986dc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617e045c-b00f-4294-b12a-476b5986dc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b522bf-d93a-416d-944d-4e76ef526eee', 'volume_name': 'volume-b0b522bf-d93a-416d-944d-4e76ef526eee', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08521fe2-2999-4e3c-9966-2ee793cb3fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08521fe2-2999-4e3c-9966-2ee793cb3fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333d84c2-a4ed-4030-bcbb-6b0cf16f4de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume b0b522bf-d93a-416d-944d-4e76ef526eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b522bf-d93a-416d-944d-4e76ef526eee', 'volume_size': 1} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a" returned: 0 in 0.742s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.067s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1207794115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9458366-f2bd-4c18-a19c-f19c113408f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505dfef567c4402eb600861fcb60aa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:18Z,use_quota=True,user_id='c26f50c1db13423eb3914f128f9a5771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Creating volume c9458366-f2bd-4c18-a19c-f19c113408f9 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:21 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9458366-f2bd-4c18-a19c-f19c113408f9 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:21 devstack sudo[111497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9458366-f2bd-4c18-a19c-f19c113408f9 1073741824 Jun 11 05:30:21 devstack sudo[111497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fbb895-640b-4c56-aa97-d937a51f159b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1e75f7-5925-4f66-9099-94037e183b1a', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cafb27-0349-4ee6-993d-92fa1f176ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume volume-bd1e75f7-5925-4f66-9099-94037e183b1a (bd1e75f7-5925-4f66-9099-94037e183b1a): created successfully Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cafb27-0349-4ee6-993d-92fa1f176ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Flow 'volume_create_manager' (1bc15a98-3c87-4e82-99f7-fbd278a2ecc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:21 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-6edd993a-593a-4031-878d-d49a46ecedc4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Created volume successfully. Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Flow 'volume_create_manager' (6ef9dc58-bdae-479a-88d5-a10dfb59c934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8b8d2f-f650-4bbf-9bed-83d0111ec103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8b8d2f-f650-4bbf-9bed-83d0111ec103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-977070817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b60961f-e3b7-409e-a6c4-879cd4eae615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4ad2497a5748748086629346be0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:21Z,use_quota=True,user_id='349e7d272e954f70a764afabe55fde67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653735e2-afac-447e-b4be-8d7991948057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653735e2-afac-447e-b4be-8d7991948057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7243a4fb-fdc8-466c-9571-47352258ede4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7243a4fb-fdc8-466c-9571-47352258ede4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b60961f-e3b7-409e-a6c4-879cd4eae615', 'volume_name': 'volume-6b60961f-e3b7-409e-a6c4-879cd4eae615', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62ccdde-687f-4533-86e0-c03519add7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62ccdde-687f-4533-86e0-c03519add7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1c9ed5-c566-4e25-9b4d-cd302fc83b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume 6b60961f-e3b7-409e-a6c4-879cd4eae615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b60961f-e3b7-409e-a6c4-879cd4eae615', 'volume_size': 1} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Flow 'volume_create_manager' (b9b6d0db-f24a-4a91-bed9-5c124c86ab2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe0fd78-106c-4d97-894d-3b753def45e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe0fd78-106c-4d97-894d-3b753def45e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1862874000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8378b3-0628-4594-8881-82127a0adc07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4ad2497a5748748086629346be0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:22Z,use_quota=True,user_id='349e7d272e954f70a764afabe55fde67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb5adfe-7b5c-4538-9260-24a85f168498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb5adfe-7b5c-4538-9260-24a85f168498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef8f71e-6fb9-4631-add9-ada37ff9fc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef8f71e-6fb9-4631-add9-ada37ff9fc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8378b3-0628-4594-8881-82127a0adc07', 'volume_name': 'volume-fa8378b3-0628-4594-8881-82127a0adc07', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b1a9be-b4b4-4146-89e7-ad8d494c0c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:21 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b1a9be-b4b4-4146-89e7-ad8d494c0c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d6cc80-2630-4855-adcc-02a82711300c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:22 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume fa8378b3-0628-4594-8881-82127a0adc07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8378b3-0628-4594-8881-82127a0adc07', 'volume_size': 1} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Flow 'volume_create_manager' (35fd8748-fed1-48a7-b642-0aa93deacbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c228bb07-8faa-4204-8ebd-97fb96340e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c228bb07-8faa-4204-8ebd-97fb96340e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762ca196-6c20-41e3-8964-7b3420d1153c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c8f60748c486bb13bc3e9b0693b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:22Z,use_quota=True,user_id='788088a682f5442f97e4dc8a13b84e30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13d59c55-6ff7-4f84-ac8a-a64087189628),volume_type_id=13d59c55-6ff7-4f84-ac8a-a64087189628)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467d0a75-1210-4e0b-85f8-71a50cd11e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467d0a75-1210-4e0b-85f8-71a50cd11e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:22 devstack sudo[111497]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2c7d5e-aae3-469c-ad58-c790572d381a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.image.glance [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Creating Keystone auth plugin from conf {{(pid=92308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9458366-f2bd-4c18-a19c-f19c113408f9 1073741824" returned: 0 in 0.918s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9458366-f2bd-4c18-a19c-f19c113408f9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:22 devstack sudo[111504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9458366-f2bd-4c18-a19c-f19c113408f9 Jun 11 05:30:22 devstack sudo[111504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2c7d5e-aae3-469c-ad58-c790572d381a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '762ca196-6c20-41e3-8964-7b3420d1153c', 'volume_name': 'volume-762ca196-6c20-41e3-8964-7b3420d1153c', 'volume_size': 1, 'image_id': 'b3554875-680d-4fed-9f5d-742880ae2afd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b3554875-680d-4fed-9f5d-742880ae2afd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37838194ae270556030ccfbbe7544972', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9b7c8f60748c486bb13bc3e9b0693b3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '61d09f60489c05beabadd8a7fcec632002357173cb3927659b374c311df7ec38d1065def134241226ca779aedcd05847369a9cce84b575059daf2967cf5e15e9', 'id': 'b3554875-680d-4fed-9f5d-742880ae2afd', 'created_at': datetime.datetime(2026, 6, 11, 3, 30, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 30, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b3554875-680d-4fed-9f5d-742880ae2afd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3980d40-a376-40c8-95e1-165770cee097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3980d40-a376-40c8-95e1-165770cee097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069b6c92-3d45-4a4e-834f-a2686341c57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:22 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Volume 762ca196-6c20-41e3-8964-7b3420d1153c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-762ca196-6c20-41e3-8964-7b3420d1153c', 'volume_size': 1, 'image_id': 'b3554875-680d-4fed-9f5d-742880ae2afd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b3554875-680d-4fed-9f5d-742880ae2afd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37838194ae270556030ccfbbe7544972', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9b7c8f60748c486bb13bc3e9b0693b3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '61d09f60489c05beabadd8a7fcec632002357173cb3927659b374c311df7ec38d1065def134241226ca779aedcd05847369a9cce84b575059daf2967cf5e15e9', 'id': 'b3554875-680d-4fed-9f5d-742880ae2afd', 'created_at': datetime.datetime(2026, 6, 11, 3, 30, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 30, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b3554875-680d-4fed-9f5d-742880ae2afd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Trying to clone 762ca196-6c20-41e3-8964-7b3420d1153c from image b3554875-680d-4fed-9f5d-742880ae2afd at location (None, [{'url': 'file:///opt/stack/data/glance/images/b3554875-680d-4fed-9f5d-742880ae2afd', 'metadata': {}}]). {{(pid=92308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 11 05:30:22 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Image download 0.00 MB at 0.00 MB/s Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fca3cde-22bb-4db3-9717-bb6453274fac]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:22 devstack sudo[111506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD Jun 11 05:30:22 devstack sudo[111506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:22 devstack sudo[111504]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9458366-f2bd-4c18-a19c-f19c113408f9" returned: 0 in 0.611s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.194s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-582145064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493a67c0-4a84-4ba3-8652-8015981b16df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505dfef567c4402eb600861fcb60aa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:18Z,use_quota=True,user_id='c26f50c1db13423eb3914f128f9a5771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Creating volume 493a67c0-4a84-4ba3-8652-8015981b16df {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:22 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-493a67c0-4a84-4ba3-8652-8015981b16df 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093b3486-1ccd-40ca-b21c-aa830f8b2f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9458366-f2bd-4c18-a19c-f19c113408f9', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3828ab5d-e10f-45ca-8844-26068213288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:22 devstack sudo[111509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-493a67c0-4a84-4ba3-8652-8015981b16df 1073741824 Jun 11 05:30:22 devstack sudo[111509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:22 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Volume volume-c9458366-f2bd-4c18-a19c-f19c113408f9 (c9458366-f2bd-4c18-a19c-f19c113408f9): created successfully Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3828ab5d-e10f-45ca-8844-26068213288b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:22 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Flow 'volume_create_manager' (4f6d40e7-5eda-415e-ac04-bb3d0a7a2714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:22 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a04ba5e6-92e6-4f88-8317-febac8134b5f tempest-CreateVolumesFromImageTest-308467742 None] Created volume successfully. Jun 11 05:30:23 devstack sudo[111506]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD" returned: 0 in 0.697s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:23 devstack sudo[111513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD Jun 11 05:30:23 devstack sudo[111513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:23 devstack sudo[111509]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-493a67c0-4a84-4ba3-8652-8015981b16df 1073741824" returned: 0 in 0.804s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-493a67c0-4a84-4ba3-8652-8015981b16df {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:23 devstack sudo[111518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-493a67c0-4a84-4ba3-8652-8015981b16df Jun 11 05:30:23 devstack sudo[111518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:23 devstack sudo[111513]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD" returned: 1 in 0.707s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:30:23 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Temporary image b3554875-680d-4fed-9f5d-742880ae2afd is fetched for user 788088a682f5442f97e4dc8a13b84e30. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06651c5-f319-4df9-9864-754e027005d9]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:24 devstack sudo[111524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD Jun 11 05:30:24 devstack sudo[111524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:24 devstack sudo[111518]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-493a67c0-4a84-4ba3-8652-8015981b16df" returned: 0 in 0.602s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.049s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-907082387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d950bf-8a58-413d-88de-a358494e11b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505dfef567c4402eb600861fcb60aa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:19Z,use_quota=True,user_id='c26f50c1db13423eb3914f128f9a5771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Creating volume d1d950bf-8a58-413d-88de-a358494e11b9 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:24 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d1d950bf-8a58-413d-88de-a358494e11b9 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e80ac3-59ff-465a-a571-6fa98fc1ccec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-493a67c0-4a84-4ba3-8652-8015981b16df', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:24 devstack sudo[111527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d1d950bf-8a58-413d-88de-a358494e11b9 1073741824 Jun 11 05:30:24 devstack sudo[111527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704139fe-45fa-452b-82a8-32b464fe7f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:24 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Volume volume-493a67c0-4a84-4ba3-8652-8015981b16df (493a67c0-4a84-4ba3-8652-8015981b16df): created successfully Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704139fe-45fa-452b-82a8-32b464fe7f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Flow 'volume_create_manager' (27056c82-aa68-40b0-ad0f-44916616093d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:24 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-7dd6bcf7-5433-49f1-a9a7-ccf98fe32f21 tempest-CreateVolumesFromImageTest-308467742 None] Created volume successfully. Jun 11 05:30:24 devstack sudo[111524]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD" returned: 0 in 0.707s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:24 devstack sudo[111534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD Jun 11 05:30:24 devstack sudo[111534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:24 devstack sudo[111527]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d1d950bf-8a58-413d-88de-a358494e11b9 1073741824" returned: 0 in 0.781s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d1d950bf-8a58-413d-88de-a358494e11b9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:25 devstack sudo[111537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d1d950bf-8a58-413d-88de-a358494e11b9 Jun 11 05:30:25 devstack sudo[111537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:25 devstack sudo[111534]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD" returned: 1 in 0.701s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:25 devstack sudo[111537]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d1d950bf-8a58-413d-88de-a358494e11b9" returned: 0 in 0.583s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.268s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560305391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c877bdc-bbde-49e2-8a2c-616e6873d883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505dfef567c4402eb600861fcb60aa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:19Z,use_quota=True,user_id='c26f50c1db13423eb3914f128f9a5771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Creating volume 0c877bdc-bbde-49e2-8a2c-616e6873d883 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:25 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0c877bdc-bbde-49e2-8a2c-616e6873d883 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:25 devstack sudo[111543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0c877bdc-bbde-49e2-8a2c-616e6873d883 1073741824 Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a407ff8-6842-4e06-93d1-6c768b4cc9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d950bf-8a58-413d-88de-a358494e11b9', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:25 devstack sudo[111543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046554b2-052d-4fc7-970d-756ed5fbd7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:25 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Volume volume-d1d950bf-8a58-413d-88de-a358494e11b9 (d1d950bf-8a58-413d-88de-a358494e11b9): created successfully Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046554b2-052d-4fc7-970d-756ed5fbd7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:25 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Flow 'volume_create_manager' (6b34edc8-6114-4af9-a030-641c0af7ecff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:25 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-ac68e9ac-9e74-4bd2-956f-8ed688c0603b tempest-CreateVolumesFromImageTest-308467742 None] Created volume successfully. Jun 11 05:30:26 devstack sudo[111543]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0c877bdc-bbde-49e2-8a2c-616e6873d883 1073741824" returned: 0 in 0.786s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0c877bdc-bbde-49e2-8a2c-616e6873d883 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:26 devstack sudo[111548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0c877bdc-bbde-49e2-8a2c-616e6873d883 Jun 11 05:30:26 devstack sudo[111548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:27 devstack sudo[111548]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0c877bdc-bbde-49e2-8a2c-616e6873d883" returned: 0 in 0.581s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.364s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-659162984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef79668-3ab9-4568-9e71-d11cd11db45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505dfef567c4402eb600861fcb60aa1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:19Z,use_quota=True,user_id='c26f50c1db13423eb3914f128f9a5771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Creating volume 0ef79668-3ab9-4568-9e71-d11cd11db45e {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:27 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ef79668-3ab9-4568-9e71-d11cd11db45e 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3921235-5c62-4c67-907a-b7d091fddc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c877bdc-bbde-49e2-8a2c-616e6873d883', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:27 devstack sudo[111551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ef79668-3ab9-4568-9e71-d11cd11db45e 1073741824 Jun 11 05:30:27 devstack sudo[111551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbb3a70-e8ea-4b12-9f53-17e9e5b3e845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:27 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Volume volume-0c877bdc-bbde-49e2-8a2c-616e6873d883 (0c877bdc-bbde-49e2-8a2c-616e6873d883): created successfully Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbb3a70-e8ea-4b12-9f53-17e9e5b3e845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Flow 'volume_create_manager' (f1d6737a-b1aa-4c05-a9d6-f1041ad02e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:27 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e2e1b3e9-3856-4457-804a-1505fcc0181f tempest-CreateVolumesFromImageTest-308467742 None] Created volume successfully. Jun 11 05:30:27 devstack sudo[111551]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ef79668-3ab9-4568-9e71-d11cd11db45e 1073741824" returned: 0 in 0.767s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ef79668-3ab9-4568-9e71-d11cd11db45e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:27 devstack sudo[111556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ef79668-3ab9-4568-9e71-d11cd11db45e Jun 11 05:30:27 devstack sudo[111556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:28 devstack sudo[111556]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ef79668-3ab9-4568-9e71-d11cd11db45e" returned: 0 in 0.610s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.200s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794272918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdf6048-b2b7-4072-9d9d-c7b438bb9757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4ad2497a5748748086629346be0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:20Z,use_quota=True,user_id='349e7d272e954f70a764afabe55fde67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Creating volume 3bdf6048-b2b7-4072-9d9d-c7b438bb9757 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:28 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1dd178-5526-4b18-8486-1f96e6cdacfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef79668-3ab9-4568-9e71-d11cd11db45e', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:28 devstack sudo[111559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757 1073741824 Jun 11 05:30:28 devstack sudo[111559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738c05b0-555d-49bd-affc-ee673feacc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:28 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Volume volume-0ef79668-3ab9-4568-9e71-d11cd11db45e (0ef79668-3ab9-4568-9e71-d11cd11db45e): created successfully Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738c05b0-555d-49bd-affc-ee673feacc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:28 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Flow 'volume_create_manager' (ec790ef6-8b3b-4b92-9219-62a6e92986aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:28 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-0588761b-6b3b-4195-9f12-dada6127ddae tempest-CreateVolumesFromImageTest-308467742 None] Created volume successfully. Jun 11 05:30:29 devstack sudo[111559]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757 1073741824" returned: 0 in 0.793s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:29 devstack sudo[111564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757 Jun 11 05:30:29 devstack sudo[111564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "cinder-0ef79668-3ab9-4568-9e71-d11cd11db45e-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-0ef79668-3ab9-4568-9e71-d11cd11db45e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "cinder-quobyte-0ef79668-3ab9-4568-9e71-d11cd11db45e" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-quobyte-0ef79668-3ab9-4568-9e71-d11cd11db45e" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4004bf02-daf5-4b42-a6f4-fd1c21ce3bae]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ef79668-3ab9-4568-9e71-d11cd11db45e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:29 devstack sudo[111566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ef79668-3ab9-4568-9e71-d11cd11db45e Jun 11 05:30:29 devstack sudo[111566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:29 devstack sudo[111564]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757" returned: 0 in 0.625s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.286s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1698163997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0473633d-36bc-4b4c-b66f-d03ba9827e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4ad2497a5748748086629346be0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:20Z,use_quota=True,user_id='349e7d272e954f70a764afabe55fde67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Creating volume 0473633d-36bc-4b4c-b66f-d03ba9827e4a {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:29 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248bcc64-36e9-4194-a297-6a96b732b00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:29 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90ff5e7-139e-4ce8-8062-396debdadd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:29 devstack sudo[111569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a 1073741824 Jun 11 05:30:29 devstack sudo[111569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:29 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757 (3bdf6048-b2b7-4072-9d9d-c7b438bb9757): created successfully Jun 11 05:30:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90ff5e7-139e-4ce8-8062-396debdadd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Flow 'volume_create_manager' (d68babb3-e706-4ed1-b885-8be5114fdda3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:30 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-5dc803fe-64a1-48a1-9599-c07238fce981 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Created volume successfully. Jun 11 05:30:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:30:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:30 devstack sudo[111574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:30 devstack sudo[111574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:30 devstack sudo[111566]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ef79668-3ab9-4568-9e71-d11cd11db45e" returned: 0 in 0.771s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ef79668-3ab9-4568-9e71-d11cd11db45e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:30 devstack sudo[111576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ef79668-3ab9-4568-9e71-d11cd11db45e Jun 11 05:30:30 devstack sudo[111576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:30 devstack sudo[111569]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a 1073741824" returned: 0 in 0.845s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:30 devstack sudo[111581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a Jun 11 05:30:30 devstack sudo[111581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:31 devstack sudo[111574]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.732s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:30:31 devstack sudo[111576]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0ef79668-3ab9-4568-9e71-d11cd11db45e" returned: 0 in 0.659s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-quobyte-0ef79668-3ab9-4568-9e71-d11cd11db45e" released by "delete_volume" :: held 1.475s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Created reservations ['95d67cb5-acbc-490f-893a-e145fc011995', 'eaf7ebfc-40f9-4edb-aec7-273a8a63042f', 'c6c60e20-9f35-4958-b0db-fe5f9ca610e2', 'e2299787-1082-49a6-8d58-6c67222a086d'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:31 devstack sudo[111585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:31 devstack sudo[111585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:31 devstack sudo[111581]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a" returned: 0 in 0.660s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.355s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-359495064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b522bf-d93a-416d-944d-4e76ef526eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4ad2497a5748748086629346be0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:21Z,use_quota=True,user_id='349e7d272e954f70a764afabe55fde67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Creating volume b0b522bf-d93a-416d-944d-4e76ef526eee {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:31 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b0b522bf-d93a-416d-944d-4e76ef526eee 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0d5b7e-24a6-40bf-86d5-3ac09b914a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:31 devstack sudo[111588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b0b522bf-d93a-416d-944d-4e76ef526eee 1073741824 Jun 11 05:30:31 devstack sudo[111588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4af836b-19ea-4be0-bc6c-3d90f4032b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:31 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a (0473633d-36bc-4b4c-b66f-d03ba9827e4a): created successfully Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4af836b-19ea-4be0-bc6c-3d90f4032b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Flow 'volume_create_manager' (e445a499-2f19-4b4f-9985-6ed8ad0a3079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:31 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a3529c10-ff57-4091-a407-4d2504e09e9a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Created volume successfully. Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "cinder-0c877bdc-bbde-49e2-8a2c-616e6873d883-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-0c877bdc-bbde-49e2-8a2c-616e6873d883-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:31 devstack sudo[111585]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.652s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "cinder-quobyte-0c877bdc-bbde-49e2-8a2c-616e6873d883" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:31 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Deleted volume successfully. Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-quobyte-0c877bdc-bbde-49e2-8a2c-616e6873d883" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-e7b53253-22ed-499d-a811-4b4618cae95c tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-0ef79668-3ab9-4568-9e71-d11cd11db45e-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5986280-701e-4a28-9afb-a84f844cb882]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0c877bdc-bbde-49e2-8a2c-616e6873d883 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:32 devstack sudo[111591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0c877bdc-bbde-49e2-8a2c-616e6873d883 Jun 11 05:30:32 devstack sudo[111591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:32 devstack sudo[111588]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b0b522bf-d93a-416d-944d-4e76ef526eee 1073741824" returned: 0 in 0.837s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b0b522bf-d93a-416d-944d-4e76ef526eee {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:32 devstack sudo[111596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b0b522bf-d93a-416d-944d-4e76ef526eee Jun 11 05:30:32 devstack sudo[111596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:32 devstack sudo[111591]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0c877bdc-bbde-49e2-8a2c-616e6873d883" returned: 0 in 0.771s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0c877bdc-bbde-49e2-8a2c-616e6873d883 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:32 devstack sudo[111601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0c877bdc-bbde-49e2-8a2c-616e6873d883 Jun 11 05:30:32 devstack sudo[111601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:33 devstack sudo[111596]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b0b522bf-d93a-416d-944d-4e76ef526eee" returned: 0 in 0.624s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.530s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-977070817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b60961f-e3b7-409e-a6c4-879cd4eae615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4ad2497a5748748086629346be0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:21Z,use_quota=True,user_id='349e7d272e954f70a764afabe55fde67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Creating volume 6b60961f-e3b7-409e-a6c4-879cd4eae615 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:33 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b60961f-e3b7-409e-a6c4-879cd4eae615 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:33 devstack sudo[111604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b60961f-e3b7-409e-a6c4-879cd4eae615 1073741824 Jun 11 05:30:33 devstack sudo[111604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333d84c2-a4ed-4030-bcbb-6b0cf16f4de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b522bf-d93a-416d-944d-4e76ef526eee', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e009f8-3891-4423-b7ec-025b1024caaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:33 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume volume-b0b522bf-d93a-416d-944d-4e76ef526eee (b0b522bf-d93a-416d-944d-4e76ef526eee): created successfully Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e009f8-3891-4423-b7ec-025b1024caaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Flow 'volume_create_manager' (2ca87ddd-6b9d-4e34-a28f-634adecae964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:33 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-137d18ce-bf08-49ae-8c08-e873e7fac941 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Created volume successfully. Jun 11 05:30:33 devstack sudo[111601]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0c877bdc-bbde-49e2-8a2c-616e6873d883" returned: 0 in 0.624s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-quobyte-0c877bdc-bbde-49e2-8a2c-616e6873d883" released by "delete_volume" :: held 1.442s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Created reservations ['ae47257c-7be0-4b99-8a07-3864269e3394', '1727186c-7f95-4e54-98e9-e8110d99e811', '342955fa-c7f5-405a-9c5c-552e211d55cb', '8454567a-3bb7-433d-b2c6-bb38410cbaf9'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:33 devstack sudo[111607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:33 devstack sudo[111607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:33 devstack sudo[111604]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b60961f-e3b7-409e-a6c4-879cd4eae615 1073741824" returned: 0 in 0.832s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:33 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b60961f-e3b7-409e-a6c4-879cd4eae615 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:33 devstack sudo[111614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b60961f-e3b7-409e-a6c4-879cd4eae615 Jun 11 05:30:33 devstack sudo[111614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "cinder-d1d950bf-8a58-413d-88de-a358494e11b9-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-d1d950bf-8a58-413d-88de-a358494e11b9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "cinder-quobyte-d1d950bf-8a58-413d-88de-a358494e11b9" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-quobyte-d1d950bf-8a58-413d-88de-a358494e11b9" acquired by "delete_volume" :: waited 0.024s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:34 devstack sudo[111607]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.717s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:34 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Deleted volume successfully. Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1527a93-3594-4690-b85f-a76270c78326]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d1d950bf-8a58-413d-88de-a358494e11b9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-196b9fd8-cfa4-4d5f-9608-26271ebcd75b tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-0c877bdc-bbde-49e2-8a2c-616e6873d883-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:34 devstack sudo[111617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d1d950bf-8a58-413d-88de-a358494e11b9 Jun 11 05:30:34 devstack sudo[111617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:34 devstack sudo[111614]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b60961f-e3b7-409e-a6c4-879cd4eae615" returned: 0 in 0.639s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.560s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1862874000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8378b3-0628-4594-8881-82127a0adc07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4ad2497a5748748086629346be0209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:22Z,use_quota=True,user_id='349e7d272e954f70a764afabe55fde67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Creating volume fa8378b3-0628-4594-8881-82127a0adc07 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:34 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fa8378b3-0628-4594-8881-82127a0adc07 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:34 devstack sudo[111620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fa8378b3-0628-4594-8881-82127a0adc07 1073741824 Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1c9ed5-c566-4e25-9b4d-cd302fc83b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b60961f-e3b7-409e-a6c4-879cd4eae615', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:34 devstack sudo[111620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6dd8f0a-2ca8-4e86-a59d-30ce4a644e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:34 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume volume-6b60961f-e3b7-409e-a6c4-879cd4eae615 (6b60961f-e3b7-409e-a6c4-879cd4eae615): created successfully Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6dd8f0a-2ca8-4e86-a59d-30ce4a644e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Flow 'volume_create_manager' (6ef9dc58-bdae-479a-88d5-a10dfb59c934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:34 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c8c86802-7fbb-4dae-ba29-8c3e09024d40 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Created volume successfully. Jun 11 05:30:34 devstack sudo[111617]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d1d950bf-8a58-413d-88de-a358494e11b9" returned: 0 in 0.787s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:34 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d1d950bf-8a58-413d-88de-a358494e11b9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:34 devstack sudo[111625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d1d950bf-8a58-413d-88de-a358494e11b9 Jun 11 05:30:34 devstack sudo[111625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:35 devstack sudo[111620]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fa8378b3-0628-4594-8881-82127a0adc07 1073741824" returned: 0 in 0.807s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fa8378b3-0628-4594-8881-82127a0adc07 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:35 devstack sudo[111630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fa8378b3-0628-4594-8881-82127a0adc07 Jun 11 05:30:35 devstack sudo[111630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:35 devstack sudo[111625]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-d1d950bf-8a58-413d-88de-a358494e11b9" returned: 0 in 0.631s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:35 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-quobyte-d1d950bf-8a58-413d-88de-a358494e11b9" released by "delete_volume" :: held 1.475s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:35 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Created reservations ['b90ed872-ff16-4e83-89a9-cd91dd275bb6', '82233fc4-f308-42a2-9a8d-29dda7be38d4', '6bd506e8-58f5-42e2-94f2-d97888f77c95', '50c641d0-6692-4247-b8fa-37dc10362d87'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:35 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:35 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:35 devstack sudo[111633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:35 devstack sudo[111633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:36 devstack sudo[111630]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fa8378b3-0628-4594-8881-82127a0adc07" returned: 0 in 0.661s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.896s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] Creating offline snapshot ad5abc62-7a1d-4197-9452-1253439743b2 of volume bd1e75f7-5925-4f66-9099-94037e183b1a {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d6cc80-2630-4855-adcc-02a82711300c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8378b3-0628-4594-8881-82127a0adc07', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422cbcbe-92c0-4252-9a45-83cafd43fc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efefa92-0e75-4ade-ac5a-53bf9f59b829]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:36 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Volume volume-fa8378b3-0628-4594-8881-82127a0adc07 (fa8378b3-0628-4594-8881-82127a0adc07): created successfully Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422cbcbe-92c0-4252-9a45-83cafd43fc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Flow 'volume_create_manager' (b9b6d0db-f24a-4a91-bed9-5c124c86ab2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:36 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-bf91e711-79c7-4966-9027-b3ef83bda499 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Created volume successfully. Jun 11 05:30:36 devstack sudo[111636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a Jun 11 05:30:36 devstack sudo[111636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "cinder-493a67c0-4a84-4ba3-8652-8015981b16df-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-493a67c0-4a84-4ba3-8652-8015981b16df-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:36 devstack sudo[111633]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.618s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:36 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Deleted volume successfully. Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-33c2b7b9-0e4e-4faa-b878-9214f78fbf2d tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-d1d950bf-8a58-413d-88de-a358494e11b9-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "cinder-quobyte-493a67c0-4a84-4ba3-8652-8015981b16df" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-quobyte-493a67c0-4a84-4ba3-8652-8015981b16df" acquired by "delete_volume" :: waited 0.014s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[17884136-305b-4dad-9f3f-b21567d2595a]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-493a67c0-4a84-4ba3-8652-8015981b16df {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:36 devstack sudo[111639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-493a67c0-4a84-4ba3-8652-8015981b16df Jun 11 05:30:36 devstack sudo[111639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:36 devstack sudo[111636]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a" returned: 0 in 0.794s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:36 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:36 devstack sudo[111644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 1G Jun 11 05:30:36 devstack sudo[111644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:37 devstack sudo[111639]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-493a67c0-4a84-4ba3-8652-8015981b16df" returned: 0 in 0.727s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-493a67c0-4a84-4ba3-8652-8015981b16df {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "cinder-fa8378b3-0628-4594-8881-82127a0adc07-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:37 devstack sudo[111649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-493a67c0-4a84-4ba3-8652-8015981b16df Jun 11 05:30:37 devstack sudo[111649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-fa8378b3-0628-4594-8881-82127a0adc07-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "cinder-quobyte-fa8378b3-0628-4594-8881-82127a0adc07" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-quobyte-fa8378b3-0628-4594-8881-82127a0adc07" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a89b2a9-5da8-424b-ab33-4818d93db69e]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fa8378b3-0628-4594-8881-82127a0adc07 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:37 devstack sudo[111651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fa8378b3-0628-4594-8881-82127a0adc07 Jun 11 05:30:37 devstack sudo[111651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:37 devstack sudo[111644]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 1G" returned: 0 in 0.820s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1e75f7-5925-4f66-9099-94037e183b1a -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:37 devstack sudo[111657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1e75f7-5925-4f66-9099-94037e183b1a -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 Jun 11 05:30:37 devstack sudo[111657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:37 devstack sudo[111649]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-493a67c0-4a84-4ba3-8652-8015981b16df" returned: 0 in 0.648s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-quobyte-493a67c0-4a84-4ba3-8652-8015981b16df" released by "delete_volume" :: held 1.428s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Created reservations ['084cba83-b3af-4856-a372-d04cea2c0721', 'deb94d08-bc71-4a20-b079-648c2cf5cb27', '24645fe1-8826-45c0-a227-dede6fd1fc93', 'b911a4af-5a33-4f3b-8db6-69263675ba90'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:37 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:38 devstack sudo[111661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:38 devstack sudo[111661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:38 devstack sudo[111651]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fa8378b3-0628-4594-8881-82127a0adc07" returned: 0 in 0.809s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fa8378b3-0628-4594-8881-82127a0adc07 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:38 devstack sudo[111664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fa8378b3-0628-4594-8881-82127a0adc07 Jun 11 05:30:38 devstack sudo[111664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:38 devstack sudo[111657]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1e75f7-5925-4f66-9099-94037e183b1a -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2" returned: 0 in 0.704s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:38 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 is being set with open permissions: ugo+rw Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:38 devstack sudo[111669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 Jun 11 05:30:38 devstack sudo[111669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "cinder-c9458366-f2bd-4c18-a19c-f19c113408f9-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-c9458366-f2bd-4c18-a19c-f19c113408f9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:38 devstack sudo[111661]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.670s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "cinder-quobyte-c9458366-f2bd-4c18-a19c-f19c113408f9" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:38 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Deleted volume successfully. Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-quobyte-c9458366-f2bd-4c18-a19c-f19c113408f9" acquired by "delete_volume" :: waited 0.022s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-52801e36-721a-4d97-b80d-9a4e779718b9 tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-493a67c0-4a84-4ba3-8652-8015981b16df-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c838a51-0dbf-469e-9a57-6546828ad6d2]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9458366-f2bd-4c18-a19c-f19c113408f9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:38 devstack sudo[111664]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-fa8378b3-0628-4594-8881-82127a0adc07" returned: 0 in 0.701s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:38 devstack sudo[111673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9458366-f2bd-4c18-a19c-f19c113408f9 Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-quobyte-fa8378b3-0628-4594-8881-82127a0adc07" released by "delete_volume" :: held 1.566s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:38 devstack sudo[111673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:38 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Created reservations ['ccaabbd1-9554-4952-8bc2-e2c8ce0bfadc', '862538a5-717f-41f1-aa9a-6dab7d84e148', '413d3bff-82eb-4efc-8059-d55ea72c171a', 'c39e1021-22bc-4ef5-b263-39eb4529c924'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:39 devstack sudo[111676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:39 devstack sudo[111676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:39 devstack sudo[111669]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2" returned: 0 in 0.708s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:39 devstack sudo[111678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.info Jun 11 05:30:39 devstack sudo[111678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "cinder-6b60961f-e3b7-409e-a6c4-879cd4eae615-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-6b60961f-e3b7-409e-a6c4-879cd4eae615-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "cinder-quobyte-6b60961f-e3b7-409e-a6c4-879cd4eae615" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:39 devstack sudo[111673]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9458366-f2bd-4c18-a19c-f19c113408f9" returned: 0 in 0.839s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9458366-f2bd-4c18-a19c-f19c113408f9 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-quobyte-6b60961f-e3b7-409e-a6c4-879cd4eae615" acquired by "delete_volume" :: waited 0.035s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:39 devstack sudo[111683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9458366-f2bd-4c18-a19c-f19c113408f9 Jun 11 05:30:39 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f856a02d-ce22-4eba-9658-d7f5f51f545f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b60961f-e3b7-409e-a6c4-879cd4eae615 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:39 devstack sudo[111685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b60961f-e3b7-409e-a6c4-879cd4eae615 Jun 11 05:30:39 devstack sudo[111685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:39 devstack sudo[111676]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.722s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:39 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Deleted volume successfully. Jun 11 05:30:39 devstack sudo[111678]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.info" returned: 0 in 0.647s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:39 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.info is being set with open permissions: ugo+rw Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:39 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-4fe00659-cf69-44a1-913d-85bfc201ae72 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-fa8378b3-0628-4594-8881-82127a0adc07-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:39 devstack sudo[111689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.info Jun 11 05:30:39 devstack sudo[111689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:40 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c9458366-f2bd-4c18-a19c-f19c113408f9" returned: 0 in 0.646s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-quobyte-c9458366-f2bd-4c18-a19c-f19c113408f9" released by "delete_volume" :: held 1.537s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Created reservations ['78d3cf5d-d750-499a-b7ba-ac06eccfcdb7', '11bd3288-367f-44ea-9227-f6d4aecb8b99', 'f59de92d-6de7-408d-94a6-ad6008a54a7a', '8a9bd1db-d187-4a9f-8ae4-9ea5b98f59bb'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:40 devstack sudo[111696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:40 devstack sudo[111696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:40 devstack sudo[111685]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b60961f-e3b7-409e-a6c4-879cd4eae615" returned: 0 in 0.775s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b60961f-e3b7-409e-a6c4-879cd4eae615 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:40 devstack sudo[111698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b60961f-e3b7-409e-a6c4-879cd4eae615 Jun 11 05:30:40 devstack sudo[111698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:40 devstack sudo[111689]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.info" returned: 0 in 0.622s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.399s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.062s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762ca196-6c20-41e3-8964-7b3420d1153c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7c8f60748c486bb13bc3e9b0693b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:22Z,use_quota=True,user_id='788088a682f5442f97e4dc8a13b84e30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13d59c55-6ff7-4f84-ac8a-a64087189628),volume_type_id=13d59c55-6ff7-4f84-ac8a-a64087189628)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Creating volume 762ca196-6c20-41e3-8964-7b3420d1153c {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:40 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:40 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:40 devstack sudo[111700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c 1073741824 Jun 11 05:30:40 devstack sudo[111700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:40 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c2c18c63-2f23-44ce-ba9f-4cf5ec263854 tempest-CreateVolumesFromSnapshotTest-377820463 None] Create snapshot completed successfully Jun 11 05:30:41 devstack sudo[111696]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.664s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:41 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Deleted volume successfully. Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-770b2bcd-66b8-4f76-bf10-29adb33452e1 tempest-CreateVolumesFromImageTest-308467742 None] Lock "cinder-c9458366-f2bd-4c18-a19c-f19c113408f9-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:41 devstack sudo[111698]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-6b60961f-e3b7-409e-a6c4-879cd4eae615" returned: 0 in 0.756s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-quobyte-6b60961f-e3b7-409e-a6c4-879cd4eae615" released by "delete_volume" :: held 1.585s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Created reservations ['237fbc30-dff5-44e8-9382-536fd5380d34', 'fadaa338-3032-4676-a986-05186f6b7f4a', '9f045e69-3699-410f-a4dd-c008f5893886', '21631d92-f963-448c-9270-0019627bd1f7'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:41 devstack sudo[111708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:41 devstack sudo[111708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Flow 'volume_create_manager' (28f79fd3-7ddf-46b6-9d4a-48c669282c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b026c4a-acc7-40b5-b01d-b044986f78f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b026c4a-acc7-40b5-b01d-b044986f78f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2095424925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00a8c83-0379-4698-a3f1-c3f87dc9dd73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a17c38e90246efa1819939614a81b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:41Z,use_quota=True,user_id='659004fffbcc4f7d8f709c064a04c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf87f45-cdca-4cc2-aec9-8025bbdb9627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf87f45-cdca-4cc2-aec9-8025bbdb9627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031eaf87-f0ec-4af6-9e5e-0175b2040eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:41 devstack sudo[111700]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031eaf87-f0ec-4af6-9e5e-0175b2040eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00a8c83-0379-4698-a3f1-c3f87dc9dd73', 'volume_name': 'volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9047deaf-d72e-4320-8899-3ffcb89d50ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9047deaf-d72e-4320-8899-3ffcb89d50ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d941faea-2424-44fc-aebd-613163c258ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:41 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume c00a8c83-0379-4698-a3f1-c3f87dc9dd73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73', 'volume_size': 1} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c 1073741824" returned: 0 in 1.028s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:41 devstack sudo[111710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c Jun 11 05:30:41 devstack sudo[111710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "cinder-b0b522bf-d93a-416d-944d-4e76ef526eee-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:41 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-b0b522bf-d93a-416d-944d-4e76ef526eee-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Flow 'volume_create_manager' (abfb24e0-ca97-42d0-870b-d8c872434cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44486042-9884-4f9f-ba16-737456504eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "cinder-quobyte-b0b522bf-d93a-416d-944d-4e76ef526eee" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44486042-9884-4f9f-ba16-737456504eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934380817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604e9d2f-a379-4cc9-85e2-8ed94dbb49ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a17c38e90246efa1819939614a81b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:42Z,use_quota=True,user_id='659004fffbcc4f7d8f709c064a04c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf111b6-3607-4eff-88fc-4705aa6d32b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf111b6-3607-4eff-88fc-4705aa6d32b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5544a2-9576-4a29-a3fc-7c8c147ae960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5544a2-9576-4a29-a3fc-7c8c147ae960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '604e9d2f-a379-4cc9-85e2-8ed94dbb49ff', 'volume_name': 'volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a054273e-ba93-4f4e-9584-9a3a8844559e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a054273e-ba93-4f4e-9584-9a3a8844559e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe81cb7-87dc-4aa8-b95f-c4943eca81fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:42 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume 604e9d2f-a379-4cc9-85e2-8ed94dbb49ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff', 'volume_size': 1} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-quobyte-b0b522bf-d93a-416d-944d-4e76ef526eee" acquired by "delete_volume" :: waited 0.066s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd476fa5-f1c2-4da6-903e-ffef4d1376f3]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b0b522bf-d93a-416d-944d-4e76ef526eee {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:42 devstack sudo[111708]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.924s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:42 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Deleted volume successfully. Jun 11 05:30:42 devstack sudo[111713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b0b522bf-d93a-416d-944d-4e76ef526eee Jun 11 05:30:42 devstack sudo[111713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c3c1c0ae-1d8d-4e51-85de-7f96cc106e8b tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-6b60961f-e3b7-409e-a6c4-879cd4eae615-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:42 devstack sudo[111710]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c" returned: 0 in 0.949s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.999s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2095424925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00a8c83-0379-4698-a3f1-c3f87dc9dd73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a17c38e90246efa1819939614a81b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:41Z,use_quota=True,user_id='659004fffbcc4f7d8f709c064a04c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Creating volume c00a8c83-0379-4698-a3f1-c3f87dc9dd73 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:42 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:42 devstack sudo[111717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73 1073741824 Jun 11 05:30:42 devstack sudo[111717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Flow 'volume_create_manager' (261df24f-3304-4b45-b299-b973b145fea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd99484-c41a-4691-ada6-ab68ed2eaa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Attempting download of b3554875-680d-4fed-9f5d-742880ae2afd ((None, [{'url': 'file:///opt/stack/data/glance/images/b3554875-680d-4fed-9f5d-742880ae2afd', 'metadata': {}}])) to volume 762ca196-6c20-41e3-8964-7b3420d1153c. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd99484-c41a-4691-ada6-ab68ed2eaa77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1315840355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45179349-5e9f-4ab8-95d3-3232864ba06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a17c38e90246efa1819939614a81b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:43Z,use_quota=True,user_id='659004fffbcc4f7d8f709c064a04c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34d49f7-6575-4286-96f2-80a46aedc994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34d49f7-6575-4286-96f2-80a46aedc994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2040316e-5f06-4edc-9156-eaa0865599cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2040316e-5f06-4edc-9156-eaa0865599cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45179349-5e9f-4ab8-95d3-3232864ba06e', 'volume_name': 'volume-45179349-5e9f-4ab8-95d3-3232864ba06e', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159b8a03-cfa1-4e13-b520-83cb43f84e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159b8a03-cfa1-4e13-b520-83cb43f84e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b454140-3c50-4d11-86e7-156379fba5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:42 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume 45179349-5e9f-4ab8-95d3-3232864ba06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45179349-5e9f-4ab8-95d3-3232864ba06e', 'volume_size': 1} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[04107abe-6cd4-4f75-82ec-3c6464745891]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:42 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b3554875-680d-4fed-9f5d-742880ae2afd_sqpmrpgk {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:43 devstack sudo[111719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b3554875-680d-4fed-9f5d-742880ae2afd_sqpmrpgk Jun 11 05:30:43 devstack sudo[111719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:43 devstack sudo[111713]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Flow 'volume_create_manager' (a92c9d36-893f-4696-beff-6b0b7441fc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7522c37a-a7ab-47f0-886f-f73274f6f709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b0b522bf-d93a-416d-944d-4e76ef526eee" returned: 0 in 0.953s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7522c37a-a7ab-47f0-886f-f73274f6f709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1612726805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c2352c-cc31-45af-99a6-524ce8d79531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a17c38e90246efa1819939614a81b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:43Z,use_quota=True,user_id='659004fffbcc4f7d8f709c064a04c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abecb6fd-d2d7-456b-a149-2e5b324a4de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abecb6fd-d2d7-456b-a149-2e5b324a4de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756187b7-a3fd-4037-8e77-7f063a49cc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756187b7-a3fd-4037-8e77-7f063a49cc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49c2352c-cc31-45af-99a6-524ce8d79531', 'volume_name': 'volume-49c2352c-cc31-45af-99a6-524ce8d79531', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4015f245-63c6-4ae0-819f-811ede531f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4015f245-63c6-4ae0-819f-811ede531f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a72087-d25d-456a-a0bd-cb9d5b57d05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:43 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume 49c2352c-cc31-45af-99a6-524ce8d79531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49c2352c-cc31-45af-99a6-524ce8d79531', 'volume_size': 1} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b0b522bf-d93a-416d-944d-4e76ef526eee {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:43 devstack sudo[111724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b0b522bf-d93a-416d-944d-4e76ef526eee Jun 11 05:30:43 devstack sudo[111724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Flow 'volume_create_manager' (2ed9eb72-0027-446f-9c49-9659fdb6e075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed8f8aa-c97b-4138-b089-a0f0f986054e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed8f8aa-c97b-4138-b089-a0f0f986054e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-861714132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fdde63-fb7c-4b1a-9073-86cbfbe31f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a17c38e90246efa1819939614a81b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:44Z,use_quota=True,user_id='659004fffbcc4f7d8f709c064a04c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402c0753-359c-423e-884f-3ed982ff0793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402c0753-359c-423e-884f-3ed982ff0793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41dc9f81-4c86-4f82-97a9-c7881a2f39dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41dc9f81-4c86-4f82-97a9-c7881a2f39dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9fdde63-fb7c-4b1a-9073-86cbfbe31f89', 'volume_name': 'volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089d4f04-fc73-4776-9c61-cdfde78f1a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089d4f04-fc73-4776-9c61-cdfde78f1a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc94a0fa-aeaf-4cc2-bc64-c968c016cc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:43 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume e9fdde63-fb7c-4b1a-9073-86cbfbe31f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89', 'volume_size': 1} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:43 devstack sudo[111717]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73 1073741824" returned: 0 in 1.339s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:43 devstack sudo[111719]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b3554875-680d-4fed-9f5d-742880ae2afd_sqpmrpgk" returned: 0 in 1.197s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:43 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b3554875-680d-4fed-9f5d-742880ae2afd_sqpmrpgk {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:43 devstack sudo[111734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73 Jun 11 05:30:43 devstack sudo[111734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:44 devstack sudo[111724]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b0b522bf-d93a-416d-944d-4e76ef526eee" returned: 0 in 0.885s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-quobyte-b0b522bf-d93a-416d-944d-4e76ef526eee" released by "delete_volume" :: held 1.964s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:44 devstack sudo[111735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b3554875-680d-4fed-9f5d-742880ae2afd_sqpmrpgk Jun 11 05:30:44 devstack sudo[111735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Created reservations ['d8b0c31a-36b1-4077-b8ce-32e2e7b2bc46', 'cd074095-a013-41c7-86c9-ae232b1d66a0', '1b52b361-f8b2-479f-9338-78970ea80a42', '766a0fc9-53d2-4617-91b0-8f36d2109374'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:44 devstack sudo[111738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:44 devstack sudo[111738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:44 devstack sudo[111734]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73" returned: 0 in 0.692s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.100s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.519s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934380817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604e9d2f-a379-4cc9-85e2-8ed94dbb49ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a17c38e90246efa1819939614a81b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:42Z,use_quota=True,user_id='659004fffbcc4f7d8f709c064a04c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Creating volume 604e9d2f-a379-4cc9-85e2-8ed94dbb49ff {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:44 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:44 devstack sudo[111741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff 1073741824 Jun 11 05:30:44 devstack sudo[111741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d941faea-2424-44fc-aebd-613163c258ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82b6188-d1f5-490b-bc97-3c99da57954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:44 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73 (c00a8c83-0379-4698-a3f1-c3f87dc9dd73): created successfully Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82b6188-d1f5-490b-bc97-3c99da57954a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Flow 'volume_create_manager' (28f79fd3-7ddf-46b6-9d4a-48c669282c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:44 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c8c5f1a7-4b9c-4cb6-b29c-2fc64553e1e3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Created volume successfully. Jun 11 05:30:44 devstack sudo[111735]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b3554875-680d-4fed-9f5d-742880ae2afd_sqpmrpgk" returned: 1 in 0.888s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b3554875-680d-4fed-9f5d-742880ae2afd_sqpmrpgk' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[256c0c0e-36e1-4e3d-8484-78403a20ade8]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:44 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:44 devstack sudo[111745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD Jun 11 05:30:44 devstack sudo[111745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:45 devstack sudo[111738]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.775s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:45 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Deleted volume successfully. Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2a44e00d-0bb4-4b4a-96bc-40171474125a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-b0b522bf-d93a-416d-944d-4e76ef526eee-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "cinder-0473633d-36bc-4b4c-b66f-d03ba9827e4a-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-0473633d-36bc-4b4c-b66f-d03ba9827e4a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Flow 'volume_create_manager' (cc8f9286-3046-4df5-94af-7a9712548f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b2ff79-e9ba-439c-bf0c-a9b2c8f9fe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "cinder-quobyte-0473633d-36bc-4b4c-b66f-d03ba9827e4a" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b2ff79-e9ba-439c-bf0c-a9b2c8f9fe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-329407702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20d0bcc-ad91-4fea-b301-b42b1b4f8951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b44be8812a3e4f41aa456e0523030eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:45Z,use_quota=True,user_id='bd11e77c6c414b22865418620610d7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acdf231a-ea06-48ba-b578-ccf978b3cfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acdf231a-ea06-48ba-b578-ccf978b3cfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb618ae6-f51d-4f70-83bc-b7372c7a1fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb618ae6-f51d-4f70-83bc-b7372c7a1fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c20d0bcc-ad91-4fea-b301-b42b1b4f8951', 'volume_name': 'volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a902b292-69d6-49c8-9f81-30e54f619cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a902b292-69d6-49c8-9f81-30e54f619cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988f3c99-5096-4fd8-b9f9-2f75a3ba547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:45 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Volume c20d0bcc-ad91-4fea-b301-b42b1b4f8951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951', 'volume_size': 1} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-quobyte-0473633d-36bc-4b4c-b66f-d03ba9827e4a" acquired by "delete_volume" :: waited 0.066s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:45 devstack sudo[111745]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD" returned: 0 in 0.754s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:45 devstack sudo[111741]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff 1073741824" returned: 0 in 0.981s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[86468dac-113b-4ba3-8bf9-1f1123b307be]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:45 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:45 devstack sudo[111755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff Jun 11 05:30:45 devstack sudo[111755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:45 devstack sudo[111753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD Jun 11 05:30:45 devstack sudo[111753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:45 devstack sudo[111754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a Jun 11 05:30:45 devstack sudo[111754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:46 devstack sudo[111755]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff" returned: 0 in 0.614s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.559s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1315840355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45179349-5e9f-4ab8-95d3-3232864ba06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a17c38e90246efa1819939614a81b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:43Z,use_quota=True,user_id='659004fffbcc4f7d8f709c064a04c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Creating volume 45179349-5e9f-4ab8-95d3-3232864ba06e {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:46 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45179349-5e9f-4ab8-95d3-3232864ba06e 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:46 devstack sudo[111753]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD" returned: 1 in 0.718s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] b3554875-680d-4fed-9f5d-742880ae2afd was raw, converting to raw {{(pid=92308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:46 devstack sudo[111766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45179349-5e9f-4ab8-95d3-3232864ba06e 1073741824 Jun 11 05:30:46 devstack sudo[111766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe81cb7-87dc-4aa8-b95f-c4943eca81fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:46 devstack sudo[111754]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6edc278f-6c5a-4681-bc70-44afba17d7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:46 devstack sudo[111768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c Jun 11 05:30:46 devstack sudo[111768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a" returned: 0 in 0.730s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:46 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff (604e9d2f-a379-4cc9-85e2-8ed94dbb49ff): created successfully Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6edc278f-6c5a-4681-bc70-44afba17d7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Flow 'volume_create_manager' (abfb24e0-ca97-42d0-870b-d8c872434cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:46 devstack sudo[111770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a Jun 11 05:30:46 devstack sudo[111770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:46 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-ad776855-0ee5-4d60-b1a7-52b3e521b043 tempest-CreateVolumesFromSnapshotTest-377820463 None] Created volume successfully. Jun 11 05:30:46 devstack sudo[111770]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:46 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-0473633d-36bc-4b4c-b66f-d03ba9827e4a" returned: 0 in 0.630s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-quobyte-0473633d-36bc-4b4c-b66f-d03ba9827e4a" released by "delete_volume" :: held 1.436s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Created reservations ['6086329a-7dba-494c-a180-2f5832763474', 'db1f885a-c24d-45d3-99f7-fe7acc81ad52', '565840d2-8689-4dcc-aa28-974930b4ddac', 'f56a8a1a-5e15-4302-b997-a794838bf0cd'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:47 devstack sudo[111766]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45179349-5e9f-4ab8-95d3-3232864ba06e 1073741824" returned: 0 in 0.826s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:47 devstack sudo[111768]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c" returned: 0 in 0.833s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b3554875-680d-4fed-9f5d-742880ae2afd_ixgjl0o9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:30:47 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Converted 0.00 MB image at 0.00 MB/s Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:47 devstack sudo[111780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:47 devstack sudo[111780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:47 devstack sudo[111781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c 1G Jun 11 05:30:47 devstack sudo[111781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45179349-5e9f-4ab8-95d3-3232864ba06e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:47 devstack sudo[111784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45179349-5e9f-4ab8-95d3-3232864ba06e Jun 11 05:30:47 devstack sudo[111784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "cinder-3bdf6048-b2b7-4072-9d9d-c7b438bb9757-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-3bdf6048-b2b7-4072-9d9d-c7b438bb9757-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "cinder-quobyte-3bdf6048-b2b7-4072-9d9d-c7b438bb9757" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-quobyte-3bdf6048-b2b7-4072-9d9d-c7b438bb9757" acquired by "delete_volume" :: waited 0.043s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0744989f-cb53-47ff-9e07-d794126a2912]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:47 devstack sudo[111780]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.714s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:47 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Deleted volume successfully. Jun 11 05:30:47 devstack sudo[111781]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c 1G" returned: 0 in 0.721s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-821b60d0-2a2b-42a1-8c46-49780ddd0062 tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-0473633d-36bc-4b4c-b66f-d03ba9827e4a-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:47 devstack sudo[111784]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45179349-5e9f-4ab8-95d3-3232864ba06e" returned: 0 in 0.701s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.738s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1612726805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c2352c-cc31-45af-99a6-524ce8d79531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a17c38e90246efa1819939614a81b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:43Z,use_quota=True,user_id='659004fffbcc4f7d8f709c064a04c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Creating volume 49c2352c-cc31-45af-99a6-524ce8d79531 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:47 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-49c2352c-cc31-45af-99a6-524ce8d79531 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:47 devstack sudo[111791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757 Jun 11 05:30:47 devstack sudo[111791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a6ce6c-a356-48d2-91ac-ce05ce3a415f]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:47 devstack sudo[111792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-49c2352c-cc31-45af-99a6-524ce8d79531 1073741824 Jun 11 05:30:47 devstack sudo[111792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b454140-3c50-4d11-86e7-156379fba5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45179349-5e9f-4ab8-95d3-3232864ba06e', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4c6087-2047-4604-a793-cfda507d6541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:47 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume volume-45179349-5e9f-4ab8-95d3-3232864ba06e (45179349-5e9f-4ab8-95d3-3232864ba06e): created successfully Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4c6087-2047-4604-a793-cfda507d6541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Flow 'volume_create_manager' (261df24f-3304-4b45-b299-b973b145fea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:48 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-03c14d42-56e1-4689-9eaf-6ebd24dc3644 tempest-CreateVolumesFromSnapshotTest-377820463 None] Created volume successfully. Jun 11 05:30:48 devstack sudo[111794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c Jun 11 05:30:48 devstack sudo[111794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:48 devstack sudo[111791]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757" returned: 0 in 0.786s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:48 devstack sudo[111806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757 Jun 11 05:30:48 devstack sudo[111806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:48 devstack sudo[111794]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c" returned: 0 in 0.765s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:48 devstack sudo[111792]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-49c2352c-cc31-45af-99a6-524ce8d79531 1073741824" returned: 0 in 0.843s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:48 devstack sudo[111808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c Jun 11 05:30:48 devstack sudo[111808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-49c2352c-cc31-45af-99a6-524ce8d79531 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:48 devstack sudo[111810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-49c2352c-cc31-45af-99a6-524ce8d79531 Jun 11 05:30:48 devstack sudo[111810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:49 devstack sudo[111806]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-3bdf6048-b2b7-4072-9d9d-c7b438bb9757" returned: 0 in 0.636s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-quobyte-3bdf6048-b2b7-4072-9d9d-c7b438bb9757" released by "delete_volume" :: held 1.476s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Created reservations ['8c8b8845-0c11-4424-aef2-e12a938e0ad3', 'b8d11bb9-6f18-4bb2-bacb-ce73b536b64a', '53e71f43-ac55-4eb6-b4d5-4ff12d096942', '40150dac-6dd9-4547-a8c2-fc6d48c77921'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:49 devstack sudo[111816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:49 devstack sudo[111816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:49 devstack sudo[111808]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c" returned: 1 in 0.738s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Downloaded image b3554875-680d-4fed-9f5d-742880ae2afd ((None, [{'url': 'file:///opt/stack/data/glance/images/b3554875-680d-4fed-9f5d-742880ae2afd', 'metadata': {}}])) to volume 762ca196-6c20-41e3-8964-7b3420d1153c successfully. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Temporary image b3554875-680d-4fed-9f5d-742880ae2afd for user 788088a682f5442f97e4dc8a13b84e30 is deleted. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Marking volume 762ca196-6c20-41e3-8964-7b3420d1153c as bootable. {{(pid=92308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Copying metadata from image b3554875-680d-4fed-9f5d-742880ae2afd to 762ca196-6c20-41e3-8964-7b3420d1153c. {{(pid=92308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Creating volume glance metadata for volume 762ca196-6c20-41e3-8964-7b3420d1153c backed by image b3554875-680d-4fed-9f5d-742880ae2afd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b3554875-680d-4fed-9f5d-742880ae2afd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '37838194ae270556030ccfbbe7544972', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 11 05:30:49 devstack sudo[111810]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-49c2352c-cc31-45af-99a6-524ce8d79531" returned: 0 in 0.658s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.672s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-861714132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fdde63-fb7c-4b1a-9073-86cbfbe31f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a17c38e90246efa1819939614a81b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:44Z,use_quota=True,user_id='659004fffbcc4f7d8f709c064a04c66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Creating volume e9fdde63-fb7c-4b1a-9073-86cbfbe31f89 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:49 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:49 devstack sudo[111819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89 1073741824 Jun 11 05:30:49 devstack sudo[111819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a72087-d25d-456a-a0bd-cb9d5b57d05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49c2352c-cc31-45af-99a6-524ce8d79531', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa79599e-f39e-44f4-99a6-a50859de0091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:49 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume volume-49c2352c-cc31-45af-99a6-524ce8d79531 (49c2352c-cc31-45af-99a6-524ce8d79531): created successfully Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa79599e-f39e-44f4-99a6-a50859de0091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Flow 'volume_create_manager' (a92c9d36-893f-4696-beff-6b0b7441fc42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c212b593-17c5-413d-8de5-df0741cc1dd4 tempest-CreateVolumesFromSnapshotTest-377820463 None] Created volume successfully. Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069b6c92-3d45-4a4e-834f-a2686341c57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-762ca196-6c20-41e3-8964-7b3420d1153c', 'volume_size': 1, 'image_id': 'b3554875-680d-4fed-9f5d-742880ae2afd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b3554875-680d-4fed-9f5d-742880ae2afd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37838194ae270556030ccfbbe7544972', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9b7c8f60748c486bb13bc3e9b0693b3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '61d09f60489c05beabadd8a7fcec632002357173cb3927659b374c311df7ec38d1065def134241226ca779aedcd05847369a9cce84b575059daf2967cf5e15e9', 'id': 'b3554875-680d-4fed-9f5d-742880ae2afd', 'created_at': datetime.datetime(2026, 6, 11, 3, 30, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 30, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b3554875-680d-4fed-9f5d-742880ae2afd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8611abc-d950-46ae-a001-4fd82ada5ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:49 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Volume volume-762ca196-6c20-41e3-8964-7b3420d1153c (762ca196-6c20-41e3-8964-7b3420d1153c): created successfully Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8611abc-d950-46ae-a001-4fd82ada5ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Flow 'volume_create_manager' (35fd8748-fed1-48a7-b642-0aa93deacbdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3c08faaa-690d-4e7d-949c-beafdf04e902 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Created volume successfully. Jun 11 05:30:49 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "cinder-1c4783c0-f78e-452b-8a53-460ee138a916-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-1c4783c0-f78e-452b-8a53-460ee138a916-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Acquiring lock "cinder-762ca196-6c20-41e3-8964-7b3420d1153c-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Lock "cinder-762ca196-6c20-41e3-8964-7b3420d1153c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:50 devstack sudo[111816]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "cinder-quobyte-1c4783c0-f78e-452b-8a53-460ee138a916" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.734s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:50 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Deleted volume successfully. Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-quobyte-1c4783c0-f78e-452b-8a53-460ee138a916" acquired by "delete_volume" :: waited 0.035s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Acquiring lock "cinder-quobyte-762ca196-6c20-41e3-8964-7b3420d1153c" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1ad59ac7-3ab1-40bd-b4ff-3932c8bcd54a tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-3bdf6048-b2b7-4072-9d9d-c7b438bb9757-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d96a920-6959-47bb-b230-c2709b03c3d5]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c4783c0-f78e-452b-8a53-460ee138a916 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Lock "cinder-quobyte-762ca196-6c20-41e3-8964-7b3420d1153c" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b3ce39-1725-42a7-a38c-fce73f04cafd]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:50 devstack sudo[111825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c4783c0-f78e-452b-8a53-460ee138a916 Jun 11 05:30:50 devstack sudo[111825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:50 devstack sudo[111827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c Jun 11 05:30:50 devstack sudo[111827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:50 devstack sudo[111819]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89 1073741824" returned: 0 in 0.941s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:50 devstack sudo[111830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89 Jun 11 05:30:50 devstack sudo[111830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:50 devstack sudo[111825]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c4783c0-f78e-452b-8a53-460ee138a916" returned: 0 in 0.747s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c4783c0-f78e-452b-8a53-460ee138a916 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:50 devstack sudo[111837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c4783c0-f78e-452b-8a53-460ee138a916 Jun 11 05:30:50 devstack sudo[111837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:51 devstack sudo[111827]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c" returned: 0 in 0.774s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:51 devstack sudo[111830]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89" returned: 0 in 0.629s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.559s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-329407702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20d0bcc-ad91-4fea-b301-b42b1b4f8951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b44be8812a3e4f41aa456e0523030eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:45Z,use_quota=True,user_id='bd11e77c6c414b22865418620610d7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Creating volume c20d0bcc-ad91-4fea-b301-b42b1b4f8951 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:51 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:51 devstack sudo[111840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c Jun 11 05:30:51 devstack sudo[111840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc94a0fa-aeaf-4cc2-bc64-c968c016cc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:51 devstack sudo[111841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 1073741824 Jun 11 05:30:51 devstack sudo[111841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9abab4f6-237d-468a-bb99-67f6392ed9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:51 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Volume volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89 (e9fdde63-fb7c-4b1a-9073-86cbfbe31f89): created successfully Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9abab4f6-237d-468a-bb99-67f6392ed9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Flow 'volume_create_manager' (2ed9eb72-0027-446f-9c49-9659fdb6e075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:51 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c4c3800b-d4e9-440c-8db9-af3f4d64adf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Created volume successfully. Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:51 devstack sudo[111837]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-1c4783c0-f78e-452b-8a53-460ee138a916" returned: 0 in 0.657s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-quobyte-1c4783c0-f78e-452b-8a53-460ee138a916" released by "delete_volume" :: held 1.469s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-quobyte-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[075521f3-3bfd-41d9-a211-7a8ae4d48ad8]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Created reservations ['4e6be2f9-de50-455c-8f07-b170f1902d51', '9ef7bdcf-fb8e-419b-a7b9-d8e23389759d', '0aa32e35-5029-4ba6-8fa4-14505664dd5b', 'f5a2bcf4-5c1b-438a-9a77-d4257f534bf4'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:51 devstack sudo[111845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89 Jun 11 05:30:51 devstack sudo[111845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:51 devstack sudo[111850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:51 devstack sudo[111850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:51 devstack sudo[111840]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c" returned: 1 in 0.927s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:30:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:51 devstack sudo[111856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c Jun 11 05:30:51 devstack sudo[111856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:52 devstack sudo[111841]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 1073741824" returned: 0 in 0.923s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:52 devstack sudo[111858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 Jun 11 05:30:52 devstack sudo[111858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:52 devstack sudo[111850]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.742s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:52 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Deleted volume successfully. Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a4140f3f-e0db-46e4-8f46-43ae4f65645d tempest-CreateVolumesFromSourceVolumeTest-659402113 None] Lock "cinder-1c4783c0-f78e-452b-8a53-460ee138a916-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:52 devstack sudo[111845]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89" returned: 0 in 1.040s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:52 devstack sudo[111856]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-762ca196-6c20-41e3-8964-7b3420d1153c" returned: 0 in 0.783s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Lock "cinder-quobyte-762ca196-6c20-41e3-8964-7b3420d1153c" released by "delete_volume" :: held 2.564s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:52 devstack sudo[111865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89 Jun 11 05:30:52 devstack sudo[111865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Created reservations ['0168e700-bf9b-42d0-b70b-0c86d69ebfe5', 'b240283c-4822-4bfe-a830-77711330b0c0', 'd703464a-a159-4642-afcb-bf4685925cee', '8457e7f9-a9cd-48bc-a704-da7c1e514c7d'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:52 devstack sudo[111858]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951" returned: 0 in 0.843s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988f3c99-5096-4fd8-b9f9-2f75a3ba547f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:53 devstack sudo[111868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:53 devstack sudo[111868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c87a417-b35b-4008-95bf-cb64e06cf9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:53 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Volume volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 (c20d0bcc-ad91-4fea-b301-b42b1b4f8951): created successfully Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c87a417-b35b-4008-95bf-cb64e06cf9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Flow 'volume_create_manager' (cc8f9286-3046-4df5-94af-7a9712548f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:53 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-6193ac73-0d8f-41b6-bdfe-007a3407438b tempest-VolumeDependencyTests-671533613 None] Created volume successfully. Jun 11 05:30:53 devstack sudo[111865]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89" returned: 0 in 0.734s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89" released by "delete_volume" :: held 1.831s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Created reservations ['511f5f4c-76aa-440f-9d89-750eed8d4c59', '99cd87c3-db47-4a0c-a496-14a9434ff207', '21760880-fb45-4dff-b93a-e8b8abe376c9', 'edadc4f1-f380-47c4-8f2a-71a777eca251'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:53 devstack sudo[111872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:53 devstack sudo[111872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-49c2352c-cc31-45af-99a6-524ce8d79531-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-49c2352c-cc31-45af-99a6-524ce8d79531-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:53 devstack sudo[111868]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.916s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-quobyte-49c2352c-cc31-45af-99a6-524ce8d79531" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:53 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Deleted volume successfully. Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b18b0a2f-6c44-49a9-9dc0-b2d638030be6 tempest-VolumeAndVolumeTypeFromImageTest-303932139 None] Lock "cinder-762ca196-6c20-41e3-8964-7b3420d1153c-delete_volume" released by "delete_volume" :: held 3.830s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-49c2352c-cc31-45af-99a6-524ce8d79531" acquired by "delete_volume" :: waited 0.038s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5caa3b-986a-4a20-86ea-4b60d3d8537c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-49c2352c-cc31-45af-99a6-524ce8d79531 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:54 devstack sudo[111876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-49c2352c-cc31-45af-99a6-524ce8d79531 Jun 11 05:30:54 devstack sudo[111876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] Creating offline snapshot 17ccac9c-4d45-4e63-92de-b6270de2934a of volume c20d0bcc-ad91-4fea-b301-b42b1b4f8951 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:30:54 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c2eee8-4409-48c0-8ed9-add5597fcac7]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:54 devstack sudo[111879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 Jun 11 05:30:54 devstack sudo[111879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:54 devstack sudo[111872]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.921s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:54 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:54 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Deleted volume successfully. Jun 11 05:30:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-523425f0-6f4c-4316-824a-55370097d079 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-e9fdde63-fb7c-4b1a-9073-86cbfbe31f89-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:55 devstack sudo[111876]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-49c2352c-cc31-45af-99a6-524ce8d79531" returned: 0 in 1.138s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-49c2352c-cc31-45af-99a6-524ce8d79531 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:55 devstack sudo[111884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-49c2352c-cc31-45af-99a6-524ce8d79531 Jun 11 05:30:55 devstack sudo[111884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:55 devstack sudo[111879]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951" returned: 0 in 0.928s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:55 devstack sudo[111890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a 1G Jun 11 05:30:55 devstack sudo[111890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:55 devstack sudo[111884]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-49c2352c-cc31-45af-99a6-524ce8d79531" returned: 0 in 0.770s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:55 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-49c2352c-cc31-45af-99a6-524ce8d79531" released by "delete_volume" :: held 1.987s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Created reservations ['6e6ca003-3b40-4de6-929b-b4e7700db767', '689ae705-de11-47cb-8fb8-af47bcad5213', 'e49b6955-663f-4872-9489-96dc3f8f4831', '8183456d-e04c-4b77-873b-fbde911398df'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:56 devstack sudo[111895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:56 devstack sudo[111895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:56 devstack sudo[111890]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a 1G" returned: 0 in 0.995s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:56 devstack sudo[111899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a Jun 11 05:30:56 devstack sudo[111899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Flow 'volume_create_manager' (03f88360-6bbc-47d5-812b-b440a91eddff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb47378f-9642-4a4d-9ee0-15981f2493c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb47378f-9642-4a4d-9ee0-15981f2493c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94b0d09-0cc1-424b-8da3-e6d1a728f004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a183263901449db13a7e8fd36098da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:57Z,use_quota=True,user_id='7d4446a1c7a447fa903ecc9fe175f742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6f806d-19d2-4266-a0e4-0cc5f1e20b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6f806d-19d2-4266-a0e4-0cc5f1e20b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af483cf-c77d-4b29-9f66-9493dee7d41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af483cf-c77d-4b29-9f66-9493dee7d41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94b0d09-0cc1-424b-8da3-e6d1a728f004', 'volume_name': 'volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee9c9e6-8971-4c4f-a159-5ef9fa634d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee9c9e6-8971-4c4f-a159-5ef9fa634d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7d02f0-fa6b-4017-af0a-24a163544706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:30:56 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Volume c94b0d09-0cc1-424b-8da3-e6d1a728f004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004', 'volume_size': 1} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:56 devstack sudo[111895]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.814s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:56 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Deleted volume successfully. Jun 11 05:30:56 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-3e5f7b65-13f4-4f39-abe8-bcf8788babf3 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-49c2352c-cc31-45af-99a6-524ce8d79531-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:57 devstack sudo[111899]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-45179349-5e9f-4ab8-95d3-3232864ba06e-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a" returned: 0 in 0.786s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:57 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a is being set with open permissions: ugo+rw Jun 11 05:30:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-45179349-5e9f-4ab8-95d3-3232864ba06e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:57 devstack sudo[111905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a Jun 11 05:30:57 devstack sudo[111905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-quobyte-45179349-5e9f-4ab8-95d3-3232864ba06e" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:57 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-45179349-5e9f-4ab8-95d3-3232864ba06e" acquired by "delete_volume" :: waited 0.029s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:57 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[904e583f-3712-4283-b45e-ea63b0a730d8]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45179349-5e9f-4ab8-95d3-3232864ba06e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:57 devstack sudo[111907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45179349-5e9f-4ab8-95d3-3232864ba06e Jun 11 05:30:57 devstack sudo[111907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:57 devstack sudo[111905]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a" returned: 0 in 0.686s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:57 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:57 devstack sudo[111910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.info Jun 11 05:30:57 devstack sudo[111910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:58 devstack sudo[111907]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45179349-5e9f-4ab8-95d3-3232864ba06e" returned: 0 in 0.781s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45179349-5e9f-4ab8-95d3-3232864ba06e {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:58 devstack sudo[111915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45179349-5e9f-4ab8-95d3-3232864ba06e Jun 11 05:30:58 devstack sudo[111915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:58 devstack sudo[111910]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.info" returned: 0 in 0.635s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:58 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.info is being set with open permissions: ugo+rw Jun 11 05:30:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:58 devstack sudo[111918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.info Jun 11 05:30:58 devstack sudo[111918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:58 devstack sudo[111915]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-45179349-5e9f-4ab8-95d3-3232864ba06e" returned: 0 in 0.624s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:58 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-45179349-5e9f-4ab8-95d3-3232864ba06e" released by "delete_volume" :: held 1.452s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:58 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Created reservations ['296a527d-0129-4094-b4a1-c06f9907a9e7', '59938466-4fb3-4a2d-9662-12d5327184d8', '2f8aa6d8-df5b-4e3c-a2f2-03b8bd819263', 'f9ed4a8b-9d5d-428a-b008-b07149a997f6'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:30:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:58 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:58 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:58 devstack sudo[111921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:30:58 devstack sudo[111921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:59 devstack sudo[111918]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.info" returned: 0 in 0.618s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.756s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.322s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94b0d09-0cc1-424b-8da3-e6d1a728f004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a183263901449db13a7e8fd36098da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:30:57Z,use_quota=True,user_id='7d4446a1c7a447fa903ecc9fe175f742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Creating volume c94b0d09-0cc1-424b-8da3-e6d1a728f004 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:30:59 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:59 devstack sudo[111925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004 1073741824 Jun 11 05:30:59 devstack sudo[111925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:30:59 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-bf1be330-6b68-4b8c-b2ac-36cb668f5025 tempest-VolumeDependencyTests-671533613 None] Create snapshot completed successfully Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:59 devstack sudo[111921]: pam_unix(sudo:session): session closed for user root Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.611s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:30:59 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Deleted volume successfully. Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-96718982-2fdb-4cea-b116-dfa3793db2d2 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-45179349-5e9f-4ab8-95d3-3232864ba06e-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-quobyte-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff" acquired by "delete_volume" :: waited 0.014s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e93ae9f-f122-4778-9089-e978399a5f73]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:30:59 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:30:59 devstack sudo[111928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff Jun 11 05:30:59 devstack sudo[111928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:00 devstack sudo[111925]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004 1073741824" returned: 0 in 0.935s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:31:00 devstack sudo[111936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004 Jun 11 05:31:00 devstack sudo[111936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Flow 'volume_create_manager' (29fcb073-ba1b-44cd-8f64-59676d78214b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a80493-c209-4f61-9b7b-372615188ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a80493-c209-4f61-9b7b-372615188ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1328709130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5847d1d4-48c4-4286-ac16-de3bd87de6e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b44be8812a3e4f41aa456e0523030eb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=17ccac9c-4d45-4e63-92de-b6270de2934a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:31:00Z,use_quota=True,user_id='bd11e77c6c414b22865418620610d7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e639ae-b0b6-4cf6-aeef-467de21d0a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e639ae-b0b6-4cf6-aeef-467de21d0a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86146e05-c7d9-472f-8a0a-172983734e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86146e05-c7d9-472f-8a0a-172983734e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5847d1d4-48c4-4286-ac16-de3bd87de6e3', 'volume_name': 'volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3', 'volume_size': 1, 'snapshot_id': '17ccac9c-4d45-4e63-92de-b6270de2934a'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed30af6e-6fba-4288-a0ea-918fb032d114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed30af6e-6fba-4288-a0ea-918fb032d114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d6661d-6779-4405-ac6d-7df4bb1a3790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:00 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Volume 5847d1d4-48c4-4286-ac16-de3bd87de6e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3', 'volume_size': 1, 'snapshot_id': '17ccac9c-4d45-4e63-92de-b6270de2934a'} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:00 devstack sudo[111928]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff" returned: 0 in 0.779s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:00 devstack sudo[111940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff Jun 11 05:31:00 devstack sudo[111940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:00 devstack sudo[111936]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004" returned: 0 in 0.626s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.497s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Acquiring lock "cinder-quobyte-17ccac9c-4d45-4e63-92de-b6270de2934a-5847d1d4-48c4-4286-ac16-de3bd87de6e3" by "_create_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7d02f0-fa6b-4017-af0a-24a163544706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daea04d7-7f4a-4821-a182-a56c2b88ad24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Lock "cinder-quobyte-17ccac9c-4d45-4e63-92de-b6270de2934a-5847d1d4-48c4-4286-ac16-de3bd87de6e3" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Creating volume 5847d1d4-48c4-4286-ac16-de3bd87de6e3 from snapshot 17ccac9c-4d45-4e63-92de-b6270de2934a {{(pid=92308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Acquiring lock "cinder-quobyte-5847d1d4-48c4-4286-ac16-de3bd87de6e3" by "_copy_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:00 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Volume volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004 (c94b0d09-0cc1-424b-8da3-e6d1a728f004): created successfully Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daea04d7-7f4a-4821-a182-a56c2b88ad24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Flow 'volume_create_manager' (03f88360-6bbc-47d5-812b-b440a91eddff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Lock "cinder-quobyte-5847d1d4-48c4-4286-ac16-de3bd87de6e3" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] snapshot: 17ccac9c-4d45-4e63-92de-b6270de2934a, volume: 5847d1d4-48c4-4286-ac16-de3bd87de6e3, {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 11 05:31:00 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-df808221-1024-45ea-8c65-e9b8b9d1f64f tempest-CinderUnicodeTest-453611462 None] Created volume successfully. Jun 11 05:31:00 devstack sudo[111940]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff" returned: 0 in 0.619s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d740b9-5210-46d8-8f1c-8ed1cc6f01d4]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:00 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff" released by "delete_volume" :: held 1.446s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Created reservations ['aaccbc35-ec4d-49d2-a228-d09104c320c7', 'a9584c01-09b0-45ec-86f7-c3f678e91591', '577b7f39-7aa5-4ef8-99cc-8a1196da8122', '2c95bb23-0a1f-41dc-adbc-192ef1da8173'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:01 devstack sudo[111944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:01 devstack sudo[111944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:01 devstack sudo[111946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:31:01 devstack sudo[111946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:01 devstack sudo[111946]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:01 devstack sudo[111944]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-c00a8c83-0379-4698-a3f1-c3f87dc9dd73-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a" returned: 0 in 0.722s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.605s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] will copy from snapshot at /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Creating direct copy from snapshot {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:31:01 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Deleted volume successfully. Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ff76ad-2b48-4d53-a405-a045a48cc6d6]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-c00a8c83-0379-4698-a3f1-c3f87dc9dd73-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-2d97c60d-057a-4bf0-9df6-a8b30731ad42 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-604e9d2f-a379-4cc9-85e2-8ed94dbb49ff-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-quobyte-c00a8c83-0379-4698-a3f1-c3f87dc9dd73" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-c00a8c83-0379-4698-a3f1-c3f87dc9dd73" acquired by "delete_volume" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7925f9ec-79ec-472b-9566-223880cb42e5]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:01 devstack sudo[111952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 Jun 11 05:31:01 devstack sudo[111952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:01 devstack sudo[111953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73 Jun 11 05:31:01 devstack sudo[111953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:02 devstack sudo[111952]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951" returned: 0 in 0.760s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG cinder.utils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Path /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3 not found in is_blk_device check {{(pid=92308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:02 devstack sudo[111962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3 Jun 11 05:31:02 devstack sudo[111962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Flow 'volume_create_manager' (cdfbb940-2689-4794-b32f-146978408c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ac66b7-79c7-4441-935f-8983120faa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ac66b7-79c7-4441-935f-8983120faa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:31:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2018024469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69bbb38-bc77-4c1d-a9a9-95fce2112294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a183263901449db13a7e8fd36098da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:31:02Z,use_quota=True,user_id='7d4446a1c7a447fa903ecc9fe175f742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643e9ab8-c6ad-4012-bcf9-f58fe1558539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643e9ab8-c6ad-4012-bcf9-f58fe1558539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:02 devstack sudo[111953]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566fd55b-f68b-469b-ae41-93511a7dd4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566fd55b-f68b-469b-ae41-93511a7dd4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69bbb38-bc77-4c1d-a9a9-95fce2112294', 'volume_name': 'volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1e22b5-8c2f-4d1c-8982-f0ccd10d35ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1e22b5-8c2f-4d1c-8982-f0ccd10d35ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbec238-7247-457f-9b53-2ee0b3f9b1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:02 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Volume f69bbb38-bc77-4c1d-a9a9-95fce2112294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294', 'volume_size': 1} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73" returned: 0 in 0.807s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:02 devstack sudo[111964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73 Jun 11 05:31:02 devstack sudo[111964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:03 devstack sudo[111964]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c00a8c83-0379-4698-a3f1-c3f87dc9dd73" returned: 0 in 0.599s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:03 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-c00a8c83-0379-4698-a3f1-c3f87dc9dd73" released by "delete_volume" :: held 1.452s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:03 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Created reservations ['3bf39578-7f62-4f4e-84d2-528dff65c9c2', '1f8da372-40a0-41a8-8a2a-bcbe2e4d8273', '88a1e9ab-34c9-4070-84ec-771f01c25091', 'cb727916-7eba-49e2-816f-4c1e26f18ac3'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:31:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:03 devstack sudo[111977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:31:03 devstack sudo[111977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-ad5abc62-7a1d-4197-9452-1253439743b2-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-ad5abc62-7a1d-4197-9452-1253439743b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-quobyte-bd1e75f7-5925-4f66-9099-94037e183b1a" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-bd1e75f7-5925-4f66-9099-94037e183b1a" acquired by "delete_snapshot" :: waited 0.062s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-quobyte-ad5abc62-7a1d-4197-9452-1253439743b2" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:04 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-ad5abc62-7a1d-4197-9452-1253439743b2" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Deleting offline snapshot ad5abc62-7a1d-4197-9452-1253439743b2 of volume bd1e75f7-5925-4f66-9099-94037e183b1a {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:31:04 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] snapshot_file for this snap is: volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:31:04 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[613ff415-ee74-4b20-8bc7-6393add4ff04]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:04 devstack sudo[111987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 Jun 11 05:31:04 devstack sudo[111987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:05 devstack sudo[111977]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 1.792s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:05 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:31:05 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Deleted volume successfully. Jun 11 05:31:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-d4dda3d2-aa2d-469a-a040-540661940d26 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-c00a8c83-0379-4698-a3f1-c3f87dc9dd73-delete_volume" released by "delete_volume" :: held 3.634s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:06 devstack sudo[111987]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2" returned: 0 in 1.916s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:06 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd1e75f7-5925-4f66-9099-94037e183b1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:31:06 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c8844b-aa37-496b-a6f4-06402c87e62f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:06 devstack sudo[111994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a Jun 11 05:31:06 devstack sudo[111994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:07 devstack sudo[111962]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3" returned: 0 in 5.227s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:07 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e517861-5425-4ae0-81b2-c10e7b40333b]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:07 devstack sudo[111994]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a" returned: 0 in 1.384s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:07 devstack sudo[112000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 Jun 11 05:31:07 devstack sudo[112000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:07 devstack sudo[111999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 Jun 11 05:31:07 devstack sudo[111999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:08 devstack sudo[112000]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2" returned: 0 in 0.697s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:08 devstack sudo[112008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2 Jun 11 05:31:08 devstack sudo[112008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:08 devstack sudo[111999]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951" returned: 0 in 0.906s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:08 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3 {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:31:08 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Converted 1024.00 MB image at 195.87 MB/s Jun 11 05:31:08 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3 is being set with open permissions: ugo+rw Jun 11 05:31:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:08 devstack sudo[112011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3 Jun 11 05:31:08 devstack sudo[112011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:09 devstack sudo[112008]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a.ad5abc62-7a1d-4197-9452-1253439743b2" returned: 0 in 0.583s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=148,cinder:UPDATE=197,cinder:INSERT=53,cinder:DELETE=23 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=137,cinder:UPDATE=207,cinder:DELETE=16,cinder:INSERT=47 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-ad5abc62-7a1d-4197-9452-1253439743b2" released by "_delete_snapshot" :: held 4.795s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-bd1e75f7-5925-4f66-9099-94037e183b1a" released by "delete_snapshot" :: held 4.861s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Created reservations ['b3318d17-33c6-4f93-8391-0c4c46a820d6', 'c7ff2229-163f-4708-89d7-15fdd96f5ea2', '494e3d7f-c6cf-48d0-a8fe-473540c41232', '4bddeb94-5c59-40d9-87ba-4477097e8263'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:31:09 devstack sudo[112011]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3" returned: 0 in 0.602s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Lock "cinder-quobyte-5847d1d4-48c4-4286-ac16-de3bd87de6e3" released by "_copy_volume_from_snapshot" :: held 8.339s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Lock "cinder-quobyte-17ccac9c-4d45-4e63-92de-b6270de2934a-5847d1d4-48c4-4286-ac16-de3bd87de6e3" released by "_create_volume_from_snapshot" :: held 8.403s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.439s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.646s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:31:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2018024469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69bbb38-bc77-4c1d-a9a9-95fce2112294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a183263901449db13a7e8fd36098da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:31:02Z,use_quota=True,user_id='7d4446a1c7a447fa903ecc9fe175f742',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Creating volume f69bbb38-bc77-4c1d-a9a9-95fce2112294 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:31:09 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:09 devstack sudo[112015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 1073741824 Jun 11 05:31:09 devstack sudo[112015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:09 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Delete snapshot completed successfully. Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-b5cabe42-dc97-4722-b076-172e44ac03f9 tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-ad5abc62-7a1d-4197-9452-1253439743b2-delete_snapshot" released by "delete_snapshot" :: held 5.097s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d6661d-6779-4405-ac6d-7df4bb1a3790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3', 'volume_size': 1, 'snapshot_id': '17ccac9c-4d45-4e63-92de-b6270de2934a'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa794d5-a359-4651-b32e-a1c28df3dcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:09 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Volume volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3 (5847d1d4-48c4-4286-ac16-de3bd87de6e3): created successfully Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa794d5-a359-4651-b32e-a1c28df3dcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Flow 'volume_create_manager' (29fcb073-ba1b-44cd-8f64-59676d78214b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:31:09 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-cc7e1d5f-0b29-4d91-9f4e-b3bd6c864885 tempest-VolumeDependencyTests-671533613 None] Created volume successfully. Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-bd1e75f7-5925-4f66-9099-94037e183b1a-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-bd1e75f7-5925-4f66-9099-94037e183b1a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "cinder-quobyte-bd1e75f7-5925-4f66-9099-94037e183b1a" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-bd1e75f7-5925-4f66-9099-94037e183b1a" acquired by "delete_volume" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84bd444-66da-4fe1-9d94-d45dc89684a4]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:09 devstack sudo[112017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a Jun 11 05:31:09 devstack sudo[112017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:10 devstack sudo[112015]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 1073741824" returned: 0 in 0.744s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:10 devstack sudo[112023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 Jun 11 05:31:10 devstack sudo[112023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Acquiring lock "cinder-17ccac9c-4d45-4e63-92de-b6270de2934a-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Lock "cinder-17ccac9c-4d45-4e63-92de-b6270de2934a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Acquiring lock "cinder-quobyte-c20d0bcc-ad91-4fea-b301-b42b1b4f8951" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Lock "cinder-quobyte-c20d0bcc-ad91-4fea-b301-b42b1b4f8951" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Acquiring lock "cinder-quobyte-17ccac9c-4d45-4e63-92de-b6270de2934a" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Lock "cinder-quobyte-17ccac9c-4d45-4e63-92de-b6270de2934a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Deleting offline snapshot 17ccac9c-4d45-4e63-92de-b6270de2934a of volume c20d0bcc-ad91-4fea-b301-b42b1b4f8951 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] snapshot_file for this snap is: volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb229f7-bb89-4081-8b8e-59d41fc97312]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:10 devstack sudo[112025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a Jun 11 05:31:10 devstack sudo[112025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:10 devstack sudo[112017]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a" returned: 0 in 0.730s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:10 devstack sudo[112031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a Jun 11 05:31:10 devstack sudo[112031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:10 devstack sudo[112023]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294" returned: 0 in 0.637s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbec238-7247-457f-9b53-2ee0b3f9b1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016cd7c0-7283-4fce-b7d4-371b33ec8eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:10 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Volume volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 (f69bbb38-bc77-4c1d-a9a9-95fce2112294): created successfully Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016cd7c0-7283-4fce-b7d4-371b33ec8eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Flow 'volume_create_manager' (cdfbb940-2689-4794-b32f-146978408c61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:31:10 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-fa727920-b08d-4cf7-86d3-1cbabbda69fa tempest-CinderUnicodeTest-453611462 None] Created volume successfully. Jun 11 05:31:10 devstack sudo[112025]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a" returned: 0 in 0.777s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eff916e-ec1d-4618-a4c4-96862f77163f]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:10 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:11 devstack sudo[112031]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-bd1e75f7-5925-4f66-9099-94037e183b1a" returned: 0 in 0.596s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-quobyte-bd1e75f7-5925-4f66-9099-94037e183b1a" released by "delete_volume" :: held 1.389s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:11 devstack sudo[112038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 Jun 11 05:31:11 devstack sudo[112038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Created reservations ['2a53d40c-3dfa-491c-9398-c2b6ff01a396', '545572a0-59fa-4348-b438-a50850d61250', '7f7f11dd-1590-4797-92fb-e365ab5615e9', 'bb4220af-69c0-4eac-bf47-a93882b200ea'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:11 devstack sudo[112040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:31:11 devstack sudo[112040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] Creating offline snapshot 93ccd525-83ed-4cdb-ad92-701985b175cd of volume f69bbb38-bc77-4c1d-a9a9-95fce2112294 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f0b10c-251d-42e0-953b-d6403f0bad44]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:11 devstack sudo[112038]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951" returned: 0 in 0.756s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:11 devstack sudo[112048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a Jun 11 05:31:11 devstack sudo[112048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:11 devstack sudo[112046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 Jun 11 05:31:11 devstack sudo[112046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:11 devstack sudo[112040]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.625s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:31:11 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Deleted volume successfully. Jun 11 05:31:11 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-8d2136f0-eadd-4560-afec-cbd7b8c3f4bf tempest-CreateVolumesFromSnapshotTest-377820463 None] Lock "cinder-bd1e75f7-5925-4f66-9099-94037e183b1a-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:12 devstack sudo[112046]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294" returned: 0 in 0.733s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:12 devstack sudo[112058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd 1G Jun 11 05:31:12 devstack sudo[112058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:12 devstack sudo[112048]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a" returned: 0 in 0.787s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:12 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:12 devstack sudo[112060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a Jun 11 05:31:12 devstack sudo[112060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:13 devstack sudo[112060]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951.17ccac9c-4d45-4e63-92de-b6270de2934a" returned: 0 in 0.717s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:13 devstack sudo[112058]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd 1G" returned: 0 in 0.879s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:13 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Lock "cinder-quobyte-17ccac9c-4d45-4e63-92de-b6270de2934a" released by "_delete_snapshot" :: held 3.152s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:13 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Lock "cinder-quobyte-c20d0bcc-ad91-4fea-b301-b42b1b4f8951" released by "delete_snapshot" :: held 3.177s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:13 devstack sudo[112067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd Jun 11 05:31:13 devstack sudo[112067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:13 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Created reservations ['e5e88186-61c2-4310-96ef-20fd1bb5da35', 'bdef20ac-38aa-4213-bf38-bfd2630aacac', 'e8951d57-d3c6-4539-9b10-3aa15168d379', 'dc039899-fd74-4b42-9d3f-2587a4d12c6a'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:31:13 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Delete snapshot completed successfully. Jun 11 05:31:13 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-fd3d112a-7dfe-4c3a-a528-6196925e9b6d tempest-VolumeDependencyTests-671533613 None] Lock "cinder-17ccac9c-4d45-4e63-92de-b6270de2934a-delete_snapshot" released by "delete_snapshot" :: held 3.339s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:13 devstack sudo[112067]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd" returned: 0 in 0.658s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:13 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd is being set with open permissions: ugo+rw Jun 11 05:31:13 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:13 devstack sudo[112073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd Jun 11 05:31:13 devstack sudo[112073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Acquiring lock "cinder-c20d0bcc-ad91-4fea-b301-b42b1b4f8951-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Lock "cinder-c20d0bcc-ad91-4fea-b301-b42b1b4f8951-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Acquiring lock "cinder-quobyte-c20d0bcc-ad91-4fea-b301-b42b1b4f8951" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:14 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Lock "cinder-quobyte-c20d0bcc-ad91-4fea-b301-b42b1b4f8951" acquired by "delete_volume" :: waited 0.017s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:14 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[255dce7b-b6b7-4641-a1e2-6ae468410526]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:14 devstack sudo[112073]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd" returned: 0 in 0.627s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:14 devstack sudo[112076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 Jun 11 05:31:14 devstack sudo[112076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:14 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:14 devstack sudo[112078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.info Jun 11 05:31:14 devstack sudo[112078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:15 devstack sudo[112076]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:15 devstack sudo[112078]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951" returned: 0 in 0.761s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.info" returned: 0 in 0.642s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:15 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.info is being set with open permissions: ugo+rw Jun 11 05:31:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:15 devstack sudo[112084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951 Jun 11 05:31:15 devstack sudo[112084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:15 devstack sudo[112085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.info Jun 11 05:31:15 devstack sudo[112085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:15 devstack sudo[112085]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.info" returned: 0 in 0.607s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:15 devstack sudo[112084]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.247s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:15 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c20d0bcc-ad91-4fea-b301-b42b1b4f8951" returned: 0 in 0.646s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:15 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Lock "cinder-quobyte-c20d0bcc-ad91-4fea-b301-b42b1b4f8951" released by "delete_volume" :: held 1.494s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:15 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-b4c4c1e7-880f-445f-9e0c-d44655cf8e3b tempest-CinderUnicodeTest-453611462 None] Create snapshot completed successfully Jun 11 05:31:15 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Created reservations ['4c9cf93d-47f2-4e6b-8614-cbdeef4b6b65', '13c671fd-2157-4f11-9edb-5b4abef348de', '1fc0e016-19fd-453d-b4f7-935a43fe2ee1', 'b61949af-2b47-4cbb-b810-f52448160d6c'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:16 devstack sudo[112091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:31:16 devstack sudo[112091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Acquiring lock "cinder-5847d1d4-48c4-4286-ac16-de3bd87de6e3-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:16 devstack sudo[112091]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.597s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Lock "cinder-5847d1d4-48c4-4286-ac16-de3bd87de6e3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:16 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Deleted volume successfully. Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f0cf9b48-b26b-4291-8337-92f02b9eb7b0 tempest-VolumeDependencyTests-671533613 None] Lock "cinder-c20d0bcc-ad91-4fea-b301-b42b1b4f8951-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Acquiring lock "cinder-quobyte-5847d1d4-48c4-4286-ac16-de3bd87de6e3" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Lock "cinder-quobyte-5847d1d4-48c4-4286-ac16-de3bd87de6e3" acquired by "delete_volume" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c11f419-90a3-4135-9b57-0b0308ceb653]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:16 devstack sudo[112094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3 Jun 11 05:31:16 devstack sudo[112094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Acquiring lock "cinder-93ccd525-83ed-4cdb-ad92-701985b175cd-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Lock "cinder-93ccd525-83ed-4cdb-ad92-701985b175cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Acquiring lock "cinder-quobyte-f69bbb38-bc77-4c1d-a9a9-95fce2112294" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Lock "cinder-quobyte-f69bbb38-bc77-4c1d-a9a9-95fce2112294" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Acquiring lock "cinder-quobyte-93ccd525-83ed-4cdb-ad92-701985b175cd" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:16 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Lock "cinder-quobyte-93ccd525-83ed-4cdb-ad92-701985b175cd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Deleting offline snapshot 93ccd525-83ed-4cdb-ad92-701985b175cd of volume f69bbb38-bc77-4c1d-a9a9-95fce2112294 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] snapshot_file for this snap is: volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93bc028-9899-48cc-a0ff-3725761ef958]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:31:17 devstack sudo[112097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd Jun 11 05:31:17 devstack sudo[112097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Flow 'volume_create_manager' (c767a4ea-2913-4468-ae75-6739694abddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9576a069-1843-47dd-b635-25cb65ef47da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9576a069-1843-47dd-b635-25cb65ef47da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601c3492-8418-4622-93cf-dc0eccda4a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b2bb0be8df4e63bbaa693a6032fff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:31:17Z,use_quota=True,user_id='fc35c9b51d954145911be29e605bda9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b7cb65-292f-4a8c-96c0-09495ca53a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b7cb65-292f-4a8c-96c0-09495ca53a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257091a3-fd86-42a7-b25b-d8ae024b1fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.image.glance [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Creating Keystone auth plugin from conf {{(pid=92308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257091a3-fd86-42a7-b25b-d8ae024b1fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '601c3492-8418-4622-93cf-dc0eccda4a3d', 'volume_name': 'volume-601c3492-8418-4622-93cf-dc0eccda4a3d', 'volume_size': 1, 'image_id': '716db752-832e-41c9-a8c1-c6ddd7fbcf83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/716db752-832e-41c9-a8c1-c6ddd7fbcf83', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c61acd9c805a7917e944c7ee27c50e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1b2bb0be8df4e63bbaa693a6032fff6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c54efe16b0ccf15c99842e66f7b92490bfddf8f98dd746ccc5745108b879acda4600c4968310b63a65be2bf56df61eefcc5826918d050389760f31a5ba05e2d1', 'id': '716db752-832e-41c9-a8c1-c6ddd7fbcf83', 'created_at': datetime.datetime(2026, 6, 11, 3, 31, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 31, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/716db752-832e-41c9-a8c1-c6ddd7fbcf83/file', 'properties': {}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1071af5f-a0db-4e17-aee0-a6999c61c604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1071af5f-a0db-4e17-aee0-a6999c61c604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5477aec1-390f-4ffe-9ef9-3e7aa2ea597f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:17 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Volume 601c3492-8418-4622-93cf-dc0eccda4a3d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-601c3492-8418-4622-93cf-dc0eccda4a3d', 'volume_size': 1, 'image_id': '716db752-832e-41c9-a8c1-c6ddd7fbcf83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/716db752-832e-41c9-a8c1-c6ddd7fbcf83', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c61acd9c805a7917e944c7ee27c50e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1b2bb0be8df4e63bbaa693a6032fff6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c54efe16b0ccf15c99842e66f7b92490bfddf8f98dd746ccc5745108b879acda4600c4968310b63a65be2bf56df61eefcc5826918d050389760f31a5ba05e2d1', 'id': '716db752-832e-41c9-a8c1-c6ddd7fbcf83', 'created_at': datetime.datetime(2026, 6, 11, 3, 31, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 31, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/716db752-832e-41c9-a8c1-c6ddd7fbcf83/file', 'properties': {}}, 'image_service': } Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Trying to clone 601c3492-8418-4622-93cf-dc0eccda4a3d from image 716db752-832e-41c9-a8c1-c6ddd7fbcf83 at location (None, [{'url': 'file:///opt/stack/data/glance/images/716db752-832e-41c9-a8c1-c6ddd7fbcf83', 'metadata': {}}]). {{(pid=92308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 11 05:31:17 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Image download 0.00 MB at 0.00 MB/s Jun 11 05:31:17 devstack sudo[112094]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3" returned: 0 in 0.852s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:17 devstack sudo[112102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3 Jun 11 05:31:17 devstack sudo[112102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad45798-3d1e-4b3c-901a-00a4e75b7d22]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:17 devstack sudo[112104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD Jun 11 05:31:17 devstack sudo[112104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:17 devstack sudo[112097]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd" returned: 0 in 0.812s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32602a9-feeb-4372-8b81-6481d3ae0f3c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:17 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:18 devstack sudo[112110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 Jun 11 05:31:18 devstack sudo[112110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:18 devstack sudo[112102]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-5847d1d4-48c4-4286-ac16-de3bd87de6e3" returned: 0 in 0.674s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:18 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Lock "cinder-quobyte-5847d1d4-48c4-4286-ac16-de3bd87de6e3" released by "delete_volume" :: held 1.571s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:18 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Created reservations ['e60601ae-2353-41e2-964c-12fcf01cd2ca', '1142995b-691c-4f72-9f52-60e52cd1b823', 'ff31f7aa-5995-487f-9399-76baeb489b45', '87ab428b-a402-4b8b-9574-242d09ae5ea4'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:31:18 devstack sudo[112104]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD" returned: 0 in 0.718s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:18 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:18 devstack sudo[112121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:31:18 devstack sudo[112121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:18 devstack sudo[112115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD Jun 11 05:31:18 devstack sudo[112115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:18 devstack sudo[112110]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294" returned: 0 in 0.768s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:18 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:18 devstack sudo[112156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd Jun 11 05:31:18 devstack sudo[112156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:19 devstack sudo[112115]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD" returned: 1 in 0.798s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:31:19 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Temporary image 716db752-832e-41c9-a8c1-c6ddd7fbcf83 is fetched for user fc35c9b51d954145911be29e605bda9f. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 11 05:31:19 devstack sudo[112121]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.765s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:19 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:31:19 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Deleted volume successfully. Jun 11 05:31:19 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-84b10a9e-1d5c-4391-90b4-585a2b37c689 tempest-VolumeDependencyTests-671533613 None] Lock "cinder-5847d1d4-48c4-4286-ac16-de3bd87de6e3-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:19 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[851f063f-3ed7-4d59-bb64-e65127265dbb]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:19 devstack sudo[112164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD Jun 11 05:31:19 devstack sudo[112164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:19 devstack sudo[112156]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd" returned: 0 in 0.890s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:19 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:19 devstack sudo[112169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd Jun 11 05:31:19 devstack sudo[112169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:19 devstack sudo[112164]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:20 devstack sudo[112175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD Jun 11 05:31:20 devstack sudo[112175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:20 devstack sudo[112169]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294.93ccd525-83ed-4cdb-ad92-701985b175cd" returned: 0 in 0.636s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Lock "cinder-quobyte-93ccd525-83ed-4cdb-ad92-701985b175cd" released by "_delete_snapshot" :: held 3.243s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Lock "cinder-quobyte-f69bbb38-bc77-4c1d-a9a9-95fce2112294" released by "delete_snapshot" :: held 3.277s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Created reservations ['c05529c1-2a58-434e-801c-aa04802a5769', '5ab96975-5602-43c5-9b15-68d937ee25de', '5f63f730-f49f-48f9-8eec-6b48cb197e5f', 'ccf36666-ca00-4607-abd6-8908f43c8134'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:31:20 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Delete snapshot completed successfully. Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-28f249d2-bbb9-4d9c-a210-bfac817be4d3 tempest-CinderUnicodeTest-453611462 None] Lock "cinder-93ccd525-83ed-4cdb-ad92-701985b175cd-delete_snapshot" released by "delete_snapshot" :: held 3.450s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:20 devstack sudo[112175]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD" returned: 1 in 0.689s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601c3492-8418-4622-93cf-dc0eccda4a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b2bb0be8df4e63bbaa693a6032fff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:31:17Z,use_quota=True,user_id='fc35c9b51d954145911be29e605bda9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Creating volume 601c3492-8418-4622-93cf-dc0eccda4a3d {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:31:20 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:31:20 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:20 devstack sudo[112181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d 1073741824 Jun 11 05:31:20 devstack sudo[112181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Acquiring lock "cinder-f69bbb38-bc77-4c1d-a9a9-95fce2112294-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Lock "cinder-f69bbb38-bc77-4c1d-a9a9-95fce2112294-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Acquiring lock "cinder-quobyte-f69bbb38-bc77-4c1d-a9a9-95fce2112294" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:21 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Lock "cinder-quobyte-f69bbb38-bc77-4c1d-a9a9-95fce2112294" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:21 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c16fbf-6b71-4c98-ba2b-fb60c068cb6c]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:21 devstack sudo[112186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 Jun 11 05:31:21 devstack sudo[112186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:21 devstack sudo[112181]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d 1073741824" returned: 0 in 0.784s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:21 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:21 devstack sudo[112189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d Jun 11 05:31:21 devstack sudo[112189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:22 devstack sudo[112186]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294" returned: 0 in 0.724s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:22 devstack sudo[112194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294 Jun 11 05:31:22 devstack sudo[112194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:22 devstack sudo[112189]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d" returned: 0 in 0.602s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Attempting download of 716db752-832e-41c9-a8c1-c6ddd7fbcf83 ((None, [{'url': 'file:///opt/stack/data/glance/images/716db752-832e-41c9-a8c1-c6ddd7fbcf83', 'metadata': {}}])) to volume 601c3492-8418-4622-93cf-dc0eccda4a3d. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[392d192e-bdd7-4b28-be20-93bfbc712be1]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_716db752-832e-41c9-a8c1-c6ddd7fbcf83_amilkpbr {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:22 devstack sudo[112197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_716db752-832e-41c9-a8c1-c6ddd7fbcf83_amilkpbr Jun 11 05:31:22 devstack sudo[112197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:22 devstack sudo[112194]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-f69bbb38-bc77-4c1d-a9a9-95fce2112294" returned: 0 in 0.592s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Lock "cinder-quobyte-f69bbb38-bc77-4c1d-a9a9-95fce2112294" released by "delete_volume" :: held 1.369s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Created reservations ['cfb09965-6264-4b1d-9468-3825edfbfda2', '10c2ac7c-f19c-433a-8fdd-27b58498585b', 'df3597a4-51fd-4615-bbd7-21bbfe28af37', 'fff10e4f-b265-4eda-af87-608e5b6808ba'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:22 devstack sudo[112200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:31:22 devstack sudo[112200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:22 devstack sudo[112197]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_716db752-832e-41c9-a8c1-c6ddd7fbcf83_amilkpbr" returned: 0 in 0.694s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:22 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_716db752-832e-41c9-a8c1-c6ddd7fbcf83_amilkpbr {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:23 devstack sudo[112204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_716db752-832e-41c9-a8c1-c6ddd7fbcf83_amilkpbr Jun 11 05:31:23 devstack sudo[112204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:23 devstack sudo[112200]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.611s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:23 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:31:23 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Deleted volume successfully. Jun 11 05:31:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-cba763ef-41a2-4383-898c-5625403cbfee tempest-CinderUnicodeTest-453611462 None] Lock "cinder-f69bbb38-bc77-4c1d-a9a9-95fce2112294-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Acquiring lock "cinder-c94b0d09-0cc1-424b-8da3-e6d1a728f004-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Lock "cinder-c94b0d09-0cc1-424b-8da3-e6d1a728f004-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Acquiring lock "cinder-quobyte-c94b0d09-0cc1-424b-8da3-e6d1a728f004" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:23 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Lock "cinder-quobyte-c94b0d09-0cc1-424b-8da3-e6d1a728f004" acquired by "delete_volume" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:23 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2dd096-418e-4eca-9cba-9fe6bd326a7d]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:23 devstack sudo[112204]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_716db752-832e-41c9-a8c1-c6ddd7fbcf83_amilkpbr" returned: 1 in 0.687s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_716db752-832e-41c9-a8c1-c6ddd7fbcf83_amilkpbr' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:31:23 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4387f939-0f21-4bd6-bd0a-c49ae29594e5]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:23 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:23 devstack sudo[112209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004 Jun 11 05:31:23 devstack sudo[112209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:23 devstack sudo[112210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD Jun 11 05:31:23 devstack sudo[112210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:24 devstack sudo[112209]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004" returned: 0 in 0.705s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:24 devstack sudo[112219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004 Jun 11 05:31:24 devstack sudo[112219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:24 devstack sudo[112210]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD" returned: 0 in 0.657s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:24 devstack sudo[112221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD Jun 11 05:31:24 devstack sudo[112221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:24 devstack sudo[112219]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-c94b0d09-0cc1-424b-8da3-e6d1a728f004" returned: 0 in 0.588s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Lock "cinder-quobyte-c94b0d09-0cc1-424b-8da3-e6d1a728f004" released by "delete_volume" :: held 1.339s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Created reservations ['1dc936dd-933a-4294-a236-965dcef8ae0d', '1a10b5af-827f-4541-8a09-f681d6893509', '7e2589f7-176f-4ab0-b766-22e3b4b91d46', '63e4428c-b1a7-46e9-aba2-e5a21b33739a'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:31:24 devstack sudo[112221]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD" returned: 1 in 0.660s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] 716db752-832e-41c9-a8c1-c6ddd7fbcf83 was raw, converting to raw {{(pid=92308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:24 devstack sudo[112227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:24 devstack sudo[112227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:24 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:24 devstack sudo[112229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:31:24 devstack sudo[112229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:25 devstack sudo[112229]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.594s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:25 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:31:25 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Deleted volume successfully. Jun 11 05:31:25 devstack sudo[112227]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d" returned: 0 in 0.673s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:25 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_716db752-832e-41c9-a8c1-c6ddd7fbcf83_dmonjkjkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:31:25 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Converted 0.00 MB image at 0.00 MB/s Jun 11 05:31:25 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:25 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-c5a25ec2-91a8-45ef-9a72-def3a6ac01d9 tempest-CinderUnicodeTest-453611462 None] Lock "cinder-c94b0d09-0cc1-424b-8da3-e6d1a728f004-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:25 devstack sudo[112235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d 1G Jun 11 05:31:25 devstack sudo[112235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:26 devstack sudo[112235]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d 1G" returned: 0 in 0.654s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:26 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab393f9f-af44-4916-a7c3-084c700afaaf]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:26 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:26 devstack sudo[112240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d Jun 11 05:31:26 devstack sudo[112240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:27 devstack sudo[112240]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d" returned: 0 in 0.744s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:27 devstack sudo[112244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d Jun 11 05:31:27 devstack sudo[112244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:27 devstack sudo[112244]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d" returned: 1 in 0.713s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:27 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:31:27 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Downloaded image 716db752-832e-41c9-a8c1-c6ddd7fbcf83 ((None, [{'url': 'file:///opt/stack/data/glance/images/716db752-832e-41c9-a8c1-c6ddd7fbcf83', 'metadata': {}}])) to volume 601c3492-8418-4622-93cf-dc0eccda4a3d successfully. {{(pid=92308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 11 05:31:27 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Temporary image 716db752-832e-41c9-a8c1-c6ddd7fbcf83 for user fc35c9b51d954145911be29e605bda9f is deleted. {{(pid=92308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 11 05:31:27 devstack cinder-volume[92308]: DEBUG cinder.volume.volume_utils [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Marking volume 601c3492-8418-4622-93cf-dc0eccda4a3d as bootable. {{(pid=92308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 11 05:31:27 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Copying metadata from image 716db752-832e-41c9-a8c1-c6ddd7fbcf83 to 601c3492-8418-4622-93cf-dc0eccda4a3d. {{(pid=92308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 11 05:31:27 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Creating volume glance metadata for volume 601c3492-8418-4622-93cf-dc0eccda4a3d backed by image 716db752-832e-41c9-a8c1-c6ddd7fbcf83 with: {'image_id': '716db752-832e-41c9-a8c1-c6ddd7fbcf83', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7c61acd9c805a7917e944c7ee27c50e2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 11 05:31:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5477aec1-390f-4ffe-9ef9-3e7aa2ea597f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601c3492-8418-4622-93cf-dc0eccda4a3d', 'volume_size': 1, 'image_id': '716db752-832e-41c9-a8c1-c6ddd7fbcf83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/716db752-832e-41c9-a8c1-c6ddd7fbcf83', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c61acd9c805a7917e944c7ee27c50e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1b2bb0be8df4e63bbaa693a6032fff6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c54efe16b0ccf15c99842e66f7b92490bfddf8f98dd746ccc5745108b879acda4600c4968310b63a65be2bf56df61eefcc5826918d050389760f31a5ba05e2d1', 'id': '716db752-832e-41c9-a8c1-c6ddd7fbcf83', 'created_at': datetime.datetime(2026, 6, 11, 3, 31, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 11, 3, 31, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/716db752-832e-41c9-a8c1-c6ddd7fbcf83/file', 'properties': {}}, 'image_service': }' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1c0b4e-e0e3-4c44-883a-3aaddec5c22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:27 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Volume volume-601c3492-8418-4622-93cf-dc0eccda4a3d (601c3492-8418-4622-93cf-dc0eccda4a3d): created successfully Jun 11 05:31:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1c0b4e-e0e3-4c44-883a-3aaddec5c22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:27 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Flow 'volume_create_manager' (c767a4ea-2913-4468-ae75-6739694abddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:31:27 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-08610554-5a41-4a35-9c79-7d96a222c2ec tempest-VolumeImageDependencyTests-2119970987 None] Created volume successfully. Jun 11 05:31:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Acquiring lock "cinder-601c3492-8418-4622-93cf-dc0eccda4a3d-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Lock "cinder-601c3492-8418-4622-93cf-dc0eccda4a3d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Acquiring lock "cinder-quobyte-601c3492-8418-4622-93cf-dc0eccda4a3d" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:29 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Lock "cinder-quobyte-601c3492-8418-4622-93cf-dc0eccda4a3d" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:29 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70b0695-4f61-4707-ae63-4811d6dd6084]: (4, 'raw') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:29 devstack sudo[112249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d Jun 11 05:31:29 devstack sudo[112249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:29 devstack sudo[112249]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d" returned: 0 in 0.732s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:29 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:30 devstack sudo[112253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d Jun 11 05:31:30 devstack sudo[112253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:30 devstack sudo[112255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:31:30 devstack sudo[112255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:30 devstack sudo[112253]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d" returned: 1 in 0.714s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d' failed. Not Retrying. {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:30 devstack sudo[112260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d Jun 11 05:31:30 devstack sudo[112260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:30 devstack sudo[112255]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.641s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:31:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 11 05:31:31 devstack sudo[112260]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-601c3492-8418-4622-93cf-dc0eccda4a3d" returned: 0 in 0.624s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:31 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Lock "cinder-quobyte-601c3492-8418-4622-93cf-dc0eccda4a3d" released by "delete_volume" :: held 2.137s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:31 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Created reservations ['ccf6b2ac-4d2f-44c4-8c96-e670c26309e8', 'd70f040f-2cc1-4757-9dc7-5f408009a8b6', 'b468ced4-84c3-4bc1-8fc2-693f09953ab5', '4c7337b1-dcb4-4f7b-ba4e-a4018358453c'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:31:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:31 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:31 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:31 devstack sudo[112264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:31:31 devstack sudo[112264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:32 devstack sudo[112264]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:32 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.619s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:32 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:31:32 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Deleted volume successfully. Jun 11 05:31:32 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-82822251-58fd-4665-b2ee-8d229647f0b0 tempest-VolumeImageDependencyTests-2119970987 None] Lock "cinder-601c3492-8418-4622-93cf-dc0eccda4a3d-delete_volume" released by "delete_volume" :: held 3.021s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:31:41 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=62,cinder:INSERT=21,cinder:UPDATE=81,cinder:DELETE=2 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:31:42 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=54,cinder:INSERT=27,cinder:UPDATE=68,cinder:DELETE=8 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Flow 'volume_create_manager' (83be93af-06ae-4169-94bb-d368a89e64fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f36bea-e0f1-4cfe-8278-d21e071b0103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f36bea-e0f1-4cfe-8278-d21e071b0103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-143641970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1771b2f-812a-4531-a63c-b8a400b07655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65459bb994f54eab893221dfe9feaa31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:31:48Z,use_quota=True,user_id='9c2769ba397e4ffb83962d0ebb1d5d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1ccdb3-8cc0-4579-97db-86cbf126229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1ccdb3-8cc0-4579-97db-86cbf126229b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa5bc68-597f-4852-9197-3a7aca014506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa5bc68-597f-4852-9197-3a7aca014506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1771b2f-812a-4531-a63c-b8a400b07655', 'volume_name': 'volume-b1771b2f-812a-4531-a63c-b8a400b07655', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e11a04-41e4-4d0d-b44f-88fe4b0457b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e11a04-41e4-4d0d-b44f-88fe4b0457b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08a9fb7-9fe8-48ac-8d73-ea1d9e1b8b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:47 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Volume b1771b2f-812a-4531-a63c-b8a400b07655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1771b2f-812a-4531-a63c-b8a400b07655', 'volume_size': 1} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-143641970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1771b2f-812a-4531-a63c-b8a400b07655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65459bb994f54eab893221dfe9feaa31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:31:48Z,use_quota=True,user_id='9c2769ba397e4ffb83962d0ebb1d5d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)}" {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Creating volume b1771b2f-812a-4531-a63c-b8a400b07655 {{(pid=92308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:31:47 devstack cinder-volume[92308]: INFO cinder.volume.drivers.remotefs [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] casted to osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 Jun 11 05:31:47 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 1073741824 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:47 devstack sudo[112269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 1073741824 Jun 11 05:31:47 devstack sudo[112269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:48 devstack sudo[112269]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 1073741824" returned: 0 in 0.755s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:48 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:48 devstack sudo[112275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 Jun 11 05:31:48 devstack sudo[112275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:49 devstack sudo[112275]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655" returned: 0 in 0.591s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:49 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'} {{(pid=92308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 11 05:31:49 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08a9fb7-9fe8-48ac-8d73-ea1d9e1b8b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1771b2f-812a-4531-a63c-b8a400b07655', 'volume_size': 1}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e153f50-78c3-4385-bd04-5061e3d561f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:49 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Volume volume-b1771b2f-812a-4531-a63c-b8a400b07655 (b1771b2f-812a-4531-a63c-b8a400b07655): created successfully Jun 11 05:31:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e153f50-78c3-4385-bd04-5061e3d561f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:49 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Flow 'volume_create_manager' (83be93af-06ae-4169-94bb-d368a89e64fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:31:49 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-07c8f10d-2cb0-4bcf-8c7c-44d211d68833 tempest-SnapshotDependencyTests-703309895 None] Created volume successfully. Jun 11 05:31:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:50 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] Creating offline snapshot 12df9c52-529f-4b81-b4cd-f5cca88d86bc of volume b1771b2f-812a-4531-a63c-b8a400b07655 {{(pid=92308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 11 05:31:50 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0510deff-a645-42c2-8559-368c60d27d32]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:50 devstack sudo[112278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 Jun 11 05:31:50 devstack sudo[112278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:50 devstack sudo[112278]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655" returned: 0 in 0.697s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:50 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc 1G {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:50 devstack sudo[112283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc 1G Jun 11 05:31:50 devstack sudo[112283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:51 devstack sudo[112283]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc 1G" returned: 0 in 0.730s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:51 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1771b2f-812a-4531-a63c-b8a400b07655 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:51 devstack sudo[112288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1771b2f-812a-4531-a63c-b8a400b07655 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc Jun 11 05:31:51 devstack sudo[112288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:52 devstack sudo[112288]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1771b2f-812a-4531-a63c-b8a400b07655 -F qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc" returned: 0 in 0.636s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:52 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc is being set with open permissions: ugo+rw Jun 11 05:31:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:52 devstack sudo[112293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc Jun 11 05:31:52 devstack sudo[112293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:52 devstack sudo[112293]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc" returned: 0 in 0.584s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:52 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:52 devstack sudo[112296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.info Jun 11 05:31:52 devstack sudo[112296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:53 devstack sudo[112296]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.info" returned: 0 in 0.585s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:53 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.info is being set with open permissions: ugo+rw Jun 11 05:31:53 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.info {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:53 devstack sudo[112299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.info Jun 11 05:31:53 devstack sudo[112299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:54 devstack sudo[112299]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.info" returned: 0 in 0.575s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.894s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:54 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-39922e37-cb21-4ab2-ba76-3b248b62cab0 tempest-SnapshotDependencyTests-703309895 None] Create snapshot completed successfully Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.flows.manager.create_volume [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Flow 'volume_create_manager' (36eef53a-6e2a-4f29-a628-b6a133f18429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c134265-90a2-40b1-a04c-ead5f1a43177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c134265-90a2-40b1-a04c-ead5f1a43177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-11T03:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e968925d-84a5-4f78-9fc2-c21ac651c9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65459bb994f54eab893221dfe9feaa31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-11T03:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=12df9c52-529f-4b81-b4cd-f5cca88d86bc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-11T03:31:55Z,use_quota=True,user_id='9c2769ba397e4ffb83962d0ebb1d5d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf0af9-d8bc-49aa-8a26-6b36252eb5a7),volume_type_id=00cf0af9-d8bc-49aa-8a26-6b36252eb5a7)' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cb2828-3d82-45d8-b2fb-665283e41eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cb2828-3d82-45d8-b2fb-665283e41eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bd83ff-8d4a-44bb-a536-64c353b2ec7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bd83ff-8d4a-44bb-a536-64c353b2ec7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e968925d-84a5-4f78-9fc2-c21ac651c9be', 'volume_name': 'volume-e968925d-84a5-4f78-9fc2-c21ac651c9be', 'volume_size': 1, 'snapshot_id': '12df9c52-529f-4b81-b4cd-f5cca88d86bc'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9daac425-be19-4d4e-92ce-fe495f2c4bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9daac425-be19-4d4e-92ce-fe495f2c4bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df26fe30-13ab-41d9-8edf-6d5f25919625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:31:54 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Volume e968925d-84a5-4f78-9fc2-c21ac651c9be: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e968925d-84a5-4f78-9fc2-c21ac651c9be', 'volume_size': 1, 'snapshot_id': '12df9c52-529f-4b81-b4cd-f5cca88d86bc'} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "cinder-quobyte-12df9c52-529f-4b81-b4cd-f5cca88d86bc-e968925d-84a5-4f78-9fc2-c21ac651c9be" by "_create_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-quobyte-12df9c52-529f-4b81-b4cd-f5cca88d86bc-e968925d-84a5-4f78-9fc2-c21ac651c9be" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Creating volume e968925d-84a5-4f78-9fc2-c21ac651c9be from snapshot 12df9c52-529f-4b81-b4cd-f5cca88d86bc {{(pid=92308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Selected osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2 as target Quobyte volume. {{(pid=92308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "cinder-quobyte-e968925d-84a5-4f78-9fc2-c21ac651c9be" by "_copy_volume_from_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-quobyte-e968925d-84a5-4f78-9fc2-c21ac651c9be" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:31:54 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] snapshot: 12df9c52-529f-4b81-b4cd-f5cca88d86bc, volume: e968925d-84a5-4f78-9fc2-c21ac651c9be, {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 11 05:31:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:31:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:31:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:31:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:31:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:31:55 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4047112e-68b1-4a52-a771-3ff8a118c852]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:55 devstack sudo[112304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc Jun 11 05:31:55 devstack sudo[112304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:55 devstack sudo[112304]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc" returned: 0 in 0.676s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1771b2f-812a-4531-a63c-b8a400b07655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:31:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] will copy from snapshot at /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 11 05:31:55 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Creating direct copy from snapshot {{(pid=92308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 11 05:31:55 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a0c2e1-940b-456b-9bd7-bab1ada1b7a9]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:31:55 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:55 devstack sudo[112309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 Jun 11 05:31:55 devstack sudo[112309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:31:56 devstack sudo[112309]: pam_unix(sudo:session): session closed for user root Jun 11 05:31:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655" returned: 0 in 0.694s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:31:56 devstack cinder-volume[92308]: DEBUG cinder.utils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Path /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be not found in is_blk_device check {{(pid=92308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 11 05:31:56 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:31:56 devstack sudo[112314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be Jun 11 05:31:56 devstack sudo[112314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:00 devstack sudo[112314]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be" returned: 0 in 4.352s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:00 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c43eaf-602b-48a7-81aa-45c461796551]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:32:00 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:32:00 devstack sudo[112328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 Jun 11 05:32:00 devstack sudo[112328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:01 devstack sudo[112328]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655" returned: 0 in 0.864s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:01 devstack cinder-volume[92308]: DEBUG cinder.image.image_utils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Image conversion details: src /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655, size 1024.00 MB, duration 4.35 sec, destination /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be {{(pid=92308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 11 05:32:01 devstack cinder-volume[92308]: INFO cinder.image.image_utils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Converted 1024.00 MB image at 235.23 MB/s Jun 11 05:32:01 devstack cinder-volume[92308]: WARNING cinder.volume.drivers.remotefs [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be is being set with open permissions: ugo+rw Jun 11 05:32:01 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:32:01 devstack sudo[112334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be Jun 11 05:32:01 devstack sudo[112334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:02 devstack sudo[112334]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be" returned: 0 in 0.590s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-quobyte-e968925d-84a5-4f78-9fc2-c21ac651c9be" released by "_copy_volume_from_snapshot" :: held 7.257s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-quobyte-12df9c52-529f-4b81-b4cd-f5cca88d86bc-e968925d-84a5-4f78-9fc2-c21ac651c9be" released by "_create_volume_from_snapshot" :: held 7.285s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.302s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df26fe30-13ab-41d9-8edf-6d5f25919625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e968925d-84a5-4f78-9fc2-c21ac651c9be', 'volume_size': 1, 'snapshot_id': '12df9c52-529f-4b81-b4cd-f5cca88d86bc'}' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f064a8-700c-41f1-8c18-ea675c33cb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 11 05:32:02 devstack cinder-volume[92308]: INFO cinder.volume.flows.manager.create_volume [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Volume volume-e968925d-84a5-4f78-9fc2-c21ac651c9be (e968925d-84a5-4f78-9fc2-c21ac651c9be): created successfully Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f064a8-700c-41f1-8c18-ea675c33cb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Flow 'volume_create_manager' (36eef53a-6e2a-4f29-a628-b6a133f18429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 11 05:32:02 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-971c0b81-0394-41f3-a184-9a2a26556620 tempest-SnapshotDependencyTests-703309895 None] Created volume successfully. Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "cinder-12df9c52-529f-4b81-b4cd-f5cca88d86bc-delete_snapshot" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-12df9c52-529f-4b81-b4cd-f5cca88d86bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "cinder-quobyte-b1771b2f-812a-4531-a63c-b8a400b07655" by "delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-quobyte-b1771b2f-812a-4531-a63c-b8a400b07655" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "cinder-quobyte-12df9c52-529f-4b81-b4cd-f5cca88d86bc" by "_delete_snapshot" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-quobyte-12df9c52-529f-4b81-b4cd-f5cca88d86bc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Deleting offline snapshot 12df9c52-529f-4b81-b4cd-f5cca88d86bc of volume b1771b2f-812a-4531-a63c-b8a400b07655 {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] snapshot_file for this snap is: volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc {{(pid=92308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcceca49-8f55-40e8-b7fa-851675025b5a]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:32:02 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:32:02 devstack sudo[112337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc Jun 11 05:32:02 devstack sudo[112337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:03 devstack sudo[112337]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc" returned: 0 in 0.683s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:03 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.remotefs [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1771b2f-812a-4531-a63c-b8a400b07655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 11 05:32:03 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a8759e-9791-455d-999c-f661be5f4ced]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:32:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:32:03 devstack sudo[112343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 Jun 11 05:32:03 devstack sudo[112343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:03 devstack sudo[112343]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655" returned: 0 in 0.688s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:03 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:32:03 devstack sudo[112348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc Jun 11 05:32:03 devstack sudo[112348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:04 devstack sudo[112348]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc" returned: 0 in 0.658s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:04 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:32:04 devstack sudo[112361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc Jun 11 05:32:04 devstack sudo[112361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:05 devstack sudo[112361]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655.12df9c52-529f-4b81-b4cd-f5cca88d86bc" returned: 0 in 0.589s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-quobyte-12df9c52-529f-4b81-b4cd-f5cca88d86bc" released by "_delete_snapshot" :: held 2.712s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:32:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-quobyte-b1771b2f-812a-4531-a63c-b8a400b07655" released by "delete_snapshot" :: held 2.734s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:32:05 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Created reservations ['650dd9bf-2546-4bf2-8297-7f7417f347b4', '64e78b2b-a354-426b-883a-0d827ede8bde', 'dbf72c79-8960-4c88-9dc8-b9d5a3211c93', '34efd03e-9378-4735-a3b4-1dc6daa3d6bf'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:32:05 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Delete snapshot completed successfully. Jun 11 05:32:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-f9f295c2-6fac-4a02-966b-137a51190c30 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-12df9c52-529f-4b81-b4cd-f5cca88d86bc-delete_snapshot" released by "delete_snapshot" :: held 2.853s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:32:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "cinder-b1771b2f-812a-4531-a63c-b8a400b07655-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:32:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-b1771b2f-812a-4531-a63c-b8a400b07655-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:32:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "cinder-quobyte-b1771b2f-812a-4531-a63c-b8a400b07655" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:32:05 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-quobyte-b1771b2f-812a-4531-a63c-b8a400b07655" acquired by "delete_volume" :: waited 0.013s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:32:05 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d23665-bafb-49ce-b34f-0db55ec18328]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:32:05 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:32:05 devstack sudo[112366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 Jun 11 05:32:05 devstack sudo[112366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:06 devstack sudo[112366]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655" returned: 0 in 0.691s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:06 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:32:06 devstack sudo[112371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655 Jun 11 05:32:06 devstack sudo[112371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:07 devstack sudo[112371]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-b1771b2f-812a-4531-a63c-b8a400b07655" returned: 0 in 0.584s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-quobyte-b1771b2f-812a-4531-a63c-b8a400b07655" released by "delete_volume" :: held 1.328s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Created reservations ['39f3af78-5824-4009-a405-ff55f2b5820e', '1ca935d0-2c07-4b38-9f54-de5afd9e67c1', 'c142e6c4-f151-4e9e-be00-d3eac3421cca', '14cfefc5-c2d5-4aef-914e-786f7900a4f4'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:32:07 devstack sudo[112374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:32:07 devstack sudo[112374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:07 devstack sudo[112374]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.570s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:32:07 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Deleted volume successfully. Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-a781ac8d-0d13-41a5-b588-02977683adf8 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-b1771b2f-812a-4531-a63c-b8a400b07655-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "cinder-e968925d-84a5-4f78-9fc2-c21ac651c9be-delete_volume" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-e968925d-84a5-4f78-9fc2-c21ac651c9be-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "cinder-quobyte-e968925d-84a5-4f78-9fc2-c21ac651c9be" by "delete_volume" {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-quobyte-e968925d-84a5-4f78-9fc2-c21ac651c9be" acquired by "delete_volume" :: waited 0.014s {{(pid=92308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fd4feb-614a-43d8-b252-eb6224771f59]: (4, 'qcow2') {{(pid=93142) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 11 05:32:07 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:32:08 devstack sudo[112377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be Jun 11 05:32:08 devstack sudo[112377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:08 devstack sudo[112377]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be" returned: 0 in 0.685s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:08 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:32:08 devstack sudo[112382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be Jun 11 05:32:08 devstack sudo[112382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:09 devstack sudo[112382]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b/volume-e968925d-84a5-4f78-9fc2-c21ac651c9be" returned: 0 in 0.587s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-quobyte-e968925d-84a5-4f78-9fc2-c21ac651c9be" released by "delete_volume" :: held 1.310s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:32:09 devstack cinder-volume[92308]: DEBUG cinder.quota [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Created reservations ['0a70f9af-664b-4743-8c76-3cdd1ee24a95', '3f24634d-6380-49d6-8841-9406abec22e7', 'ce565194-93b9-4e74-9798-50ad24a4fe2f', 'e9edf72c-241f-4e43-a87a-a6d6fc1573c9'] {{(pid=92308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 11 05:32:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:32:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:32:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:32:09 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:32:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:32:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:32:09 devstack sudo[112385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:32:09 devstack sudo[112385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:09 devstack sudo[112385]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:09 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.579s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:09 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:32:09 devstack cinder-volume[92308]: INFO cinder.volume.manager [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Deleted volume successfully. Jun 11 05:32:09 devstack cinder-volume[92308]: DEBUG cinder.coordination [None req-1c9314a6-8b1f-40ea-9865-83010a19ade9 tempest-SnapshotDependencyTests-703309895 None] Lock "cinder-e968925d-84a5-4f78-9fc2-c21ac651c9be-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=92308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 11 05:32:19 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:SELECT=22,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=3 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:32:19 devstack cinder-volume[92308]: DEBUG dbcounter [-] [92308] Writing DB stats cinder:UPDATE=25,cinder:SELECT=25,cinder:DELETE=2,cinder:INSERT=6 {{(pid=92308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 11 05:32:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:32:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 11 05:32:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 11 05:32:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2': None} {{(pid=92308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 11 05:32:30 devstack cinder-volume[92308]: DEBUG cinder.volume.drivers.quobyte [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c45f4bb6-c9ab-41cc-8fed-96d70c8c99c2'] {{(pid=92308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 11 05:32:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.lockutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 11 05:32:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 11 05:32:30 devstack sudo[112439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b Jun 11 05:32:30 devstack sudo[112439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 11 05:32:30 devstack sudo[112439]: pam_unix(sudo:session): session closed for user root Jun 11 05:32:30 devstack cinder-volume[92308]: DEBUG oslo_concurrency.processutils [None req-f855880e-8323-414d-885a-870b1b56bffa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/718afe4cf22995d0275cf6fa52b1191b" returned: 0 in 0.590s {{(pid=92308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 11 05:32:30 devstack cinder-volume[92308]: DEBUG cinder.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Notifying Schedulers of capabilities ... {{(pid=92308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 11 05:32:30 devstack cinder-volume[92308]: DEBUG oslo_service.periodic_task [None req-f855880e-8323-414d-885a-870b1b56bffa None None] Running periodic task VolumeManager._thread_info {{(pid=92308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 11 05:32:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread count: 28 {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 11 05:32:30 devstack cinder-volume[92308]: DEBUG cinder.volume.manager [None req-f855880e-8323-414d-885a-870b1b56bffa None None] thread info: [<_MainThread(MainThread, started 131891722371200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}